Nov 15 14:12:34 user nova-compute[74892]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74892) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 14:12:34 user nova-compute[74892]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74892) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 14:12:34 user nova-compute[74892]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74892) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 14:12:34 user nova-compute[74892]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 14:12:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:12:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:12:34 user nova-compute[74892]: INFO nova.virt.driver [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 14:12:35 user nova-compute[74892]: INFO nova.compute.provider_config [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] Acquiring lock "singleton_lock" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] Acquired lock "singleton_lock" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] Releasing lock "singleton_lock" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] Full set of CONF: {{(pid=74892) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ******************************************************************************** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] Configuration options gathered from: {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ================================================================================ {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] allow_resize_to_same_host      = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] arq_binding_timeout            = 300 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] backdoor_port                  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] backdoor_socket                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] block_device_allocate_retries  = 300 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] block_device_allocate_retries_interval = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cert                           = self.pem {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute_monitors               = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] config_dir                     = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] config_drive_format            = iso9660 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] config_source                  = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] console_host                   = user {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] control_exchange               = nova {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cpu_allocation_ratio           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] daemon                         = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] debug                          = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] default_access_ip_network_name = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] default_availability_zone      = nova {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] default_ephemeral_format       = ext4 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] default_green_pool_size        = 1000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] default_schedule_zone          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] disk_allocation_ratio          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] enable_new_services            = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] enabled_apis                   = ['osapi_compute'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] enabled_ssl_apis               = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] flat_injected                  = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] force_config_drive             = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] force_raw_images               = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] graceful_shutdown_timeout      = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] heal_instance_info_cache_interval = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] host                           = user {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] instance_build_timeout         = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] instance_delete_interval       = 300 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] instance_format                = [instance: %(uuid)s]  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] instance_name_template         = instance-%08x {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] instance_usage_audit           = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] instance_usage_audit_period    = month {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] internal_service_availability_zone = internal {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] key                            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] live_migration_retry_count     = 30 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] log_config_append              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] log_dir                        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] log_file                       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] log_options                    = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] log_rotate_interval            = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] log_rotate_interval_type       = days {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] log_rotation_type              = none {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] long_rpc_timeout               = 1800 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] max_concurrent_builds          = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] max_concurrent_live_migrations = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] max_concurrent_snapshots       = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] max_local_block_devices        = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] max_logfile_count              = 30 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] max_logfile_size_mb            = 200 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] maximum_instance_delete_attempts = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] metadata_listen                = 0.0.0.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] metadata_listen_port           = 8775 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] metadata_workers               = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] migrate_max_retries            = -1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] mkisofs_cmd                    = genisoimage {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] my_ip                          = 10.0.0.210 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] network_allocate_retries       = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] osapi_compute_listen_port      = 8774 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] osapi_compute_unique_server_name_scope =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] osapi_compute_workers          = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] password_length                = 12 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] periodic_enable                = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] periodic_fuzzy_delay           = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] pointer_model                  = ps2mouse {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] preallocate_images             = none {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] publish_errors                 = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] pybasedir                      = /opt/stack/nova {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ram_allocation_ratio           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] rate_limit_burst               = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] rate_limit_except_level        = CRITICAL {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] rate_limit_interval            = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] reboot_timeout                 = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] reclaim_instance_interval      = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] record                         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] reimage_timeout_per_gb         = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] report_interval                = 120 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] rescue_timeout                 = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] reserved_host_cpus             = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] reserved_host_disk_mb          = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] reserved_host_memory_mb        = 512 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] reserved_huge_pages            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] resize_confirm_window          = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] resize_fs_using_block_device   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] resume_guests_state_on_host_boot = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] rpc_response_timeout           = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] run_external_periodic_tasks    = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] running_deleted_instance_action = reap {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] running_deleted_instance_poll_interval = 1800 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] running_deleted_instance_timeout = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler_instance_sync_interval = 120 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_down_time              = 720 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] servicegroup_driver            = db {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] shelved_offload_time           = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] shelved_poll_interval          = 3600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] shutdown_timeout               = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] source_is_ipv6                 = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ssl_only                       = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] state_path                     = /opt/stack/data/nova {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] sync_power_state_interval      = 600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] sync_power_state_pool_size     = 1000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] syslog_log_facility            = LOG_USER {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] tempdir                        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] timeout_nbd                    = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] transport_url                  = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] update_resources_interval      = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] use_cow_images                 = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] use_eventlog                   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] use_journal                    = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] use_json                       = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] use_rootwrap_daemon            = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] use_stderr                     = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] use_syslog                     = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vcpu_pin_set                   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plugging_is_fatal          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plugging_timeout           = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] virt_mkfs                      = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] volume_usage_poll_interval     = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] watch_log_file                 = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] web                            = /usr/share/spice-html5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_concurrency.disable_process_locking = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.auth_strategy              = keystone {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.compute_link_prefix        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.dhcp_domain                = novalocal {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.enable_instance_password   = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.glance_link_prefix         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.instance_list_per_project_cells = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.list_records_by_skipping_down_cells = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.local_metadata_per_cell    = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.max_limit                  = 1000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.metadata_cache_expiration  = 15 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.neutron_default_tenant_id  = default {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.use_forwarded_for          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.use_neutron_default_nets   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.vendordata_dynamic_targets = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.vendordata_jsonfile_path   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.backend                  = dogpile.cache.memcached {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.backend_argument         = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.config_prefix            = cache.oslo {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.dead_timeout             = 60.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.debug_cache_backend      = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.enable_retry_client      = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.enable_socket_keepalive  = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.enabled                  = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.expiration_time          = 600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.hashclient_retry_attempts = 2 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_dead_retry      = 300 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_password        =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_pool_maxsize    = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_sasl_enabled    = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.memcache_username        =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.proxies                  = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.retry_attempts           = 2 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.retry_delay              = 0.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.socket_keepalive_count   = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.socket_keepalive_idle    = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.socket_keepalive_interval = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.tls_allowed_ciphers      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.tls_cafile               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.tls_certfile             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.tls_enabled              = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cache.tls_keyfile              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.auth_section            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.auth_type               = password {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.cafile                  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.certfile                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.collect_timing          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.cross_az_attach         = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.debug                   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.endpoint_template       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.http_retries            = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.insecure                = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.keyfile                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.os_region_name          = RegionOne {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.split_loggers           = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cinder.timeout                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.cpu_dedicated_set      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.cpu_shared_set         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.image_type_exclude_list = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.max_concurrent_disk_ops = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.max_disk_devices_to_attach = -1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.resource_provider_association_refresh = 300 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.shutdown_retry_interval = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] conductor.workers              = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] console.allowed_origins        = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] console.ssl_ciphers            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] console.ssl_minimum_version    = default {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] consoleauth.token_ttl          = 600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.cafile                  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.certfile                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.collect_timing          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.connect_retries         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.connect_retry_delay     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.endpoint_override       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.insecure                = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.keyfile                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.max_version             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.min_version             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.region_name             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.service_name            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.service_type            = accelerator {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.split_loggers           = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.status_code_retries     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.status_code_retry_delay = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.timeout                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] cyborg.version                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.backend               = sqlalchemy {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.connection            = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.connection_debug      = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.connection_parameters =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.connection_recycle_time = 3600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.connection_trace      = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.db_inc_retry_interval = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.db_max_retries        = 20 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.db_max_retry_interval = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.db_retry_interval     = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.max_overflow          = 50 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.max_pool_size         = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.max_retries           = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.mysql_wsrep_sync_wait = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.pool_timeout          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.retry_interval        = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.slave_connection      = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] database.sqlite_synchronous    = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.backend           = sqlalchemy {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.connection        = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.connection_debug  = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.connection_parameters =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.connection_recycle_time = 3600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.connection_trace  = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.db_inc_retry_interval = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.db_max_retries    = 20 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.db_max_retry_interval = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.db_retry_interval = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.max_overflow      = 50 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.max_pool_size     = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.max_retries       = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.pool_timeout      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.retry_interval    = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.slave_connection  = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] api_database.sqlite_synchronous = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] devices.enabled_mdev_types     = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ephemeral_storage_encryption.enabled = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.api_servers             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.cafile                  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.certfile                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.collect_timing          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.connect_retries         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.connect_retry_delay     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.debug                   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.default_trusted_certificate_ids = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.enable_certificate_validation = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.enable_rbd_download     = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.endpoint_override       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.insecure                = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.keyfile                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.max_version             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.min_version             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.num_retries             = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.rbd_ceph_conf           =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.rbd_connect_timeout     = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.rbd_pool                =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.rbd_user                =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.region_name             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.service_name            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.service_type            = image {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.split_loggers           = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.status_code_retries     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.status_code_retry_delay = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.timeout                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.verify_glance_signatures = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] glance.version                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] guestfs.debug                  = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.config_drive_cdrom      = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.config_drive_inject_password = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.enable_instance_metrics_collection = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.enable_remotefx         = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.instances_path_share    =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.iscsi_initiator_list    = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.limit_cpu_features      = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.power_state_check_timeframe = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.use_multipath_io        = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.volume_attach_retry_count = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.vswitch_name            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] mks.enabled                    = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] image_cache.manager_interval   = 2400 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] image_cache.precache_concurrency = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] image_cache.remove_unused_base_images = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] image_cache.subdirectory_name  = _base {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.api_max_retries         = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.api_retry_interval      = 2 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.auth_section            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.auth_type               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.cafile                  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.certfile                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.collect_timing          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.conductor_group         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.connect_retries         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.connect_retry_delay     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.endpoint_override       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.insecure                = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.keyfile                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.max_version             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.min_version             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.peer_list               = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.region_name             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.serial_console_state_timeout = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.service_name            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.service_type            = baremetal {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.split_loggers           = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.status_code_retries     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.status_code_retry_delay = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.timeout                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ironic.version                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] key_manager.fixed_key          = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.barbican_api_version  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.barbican_endpoint     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.barbican_endpoint_type = public {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.barbican_region_name  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.cafile                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.certfile              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.collect_timing        = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.insecure              = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.keyfile               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.number_of_retries     = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.retry_delay           = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.send_service_user_token = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.split_loggers         = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.timeout               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.verify_ssl            = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican.verify_ssl_path       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.auth_section = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.auth_type = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.cafile   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.certfile = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.collect_timing = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.insecure = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.keyfile  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.split_loggers = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] barbican_service_user.timeout  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.approle_role_id          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.approle_secret_id        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.cafile                   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.certfile                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.collect_timing           = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.insecure                 = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.keyfile                  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.kv_mountpoint            = secret {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.kv_path                  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.kv_version               = 2 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.namespace                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.root_token_id            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.split_loggers            = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.ssl_ca_crt_file          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.timeout                  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.use_ssl                  = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.auth_section          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.auth_type             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.cafile                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.certfile              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.collect_timing        = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.connect_retries       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.connect_retry_delay   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.endpoint_override     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.insecure              = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.keyfile               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.max_version           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.min_version           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.region_name           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.service_name          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.service_type          = identity {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.split_loggers         = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.status_code_retries   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.status_code_retry_delay = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.timeout               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] keystone.version               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.connection_uri         =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.cpu_mode               = custom {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: WARNING oslo_config.cfg [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.cpu_power_governor_high = performance {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.cpu_power_governor_low = powersave {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.cpu_power_management   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.device_detach_attempts = 8 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.device_detach_timeout  = 20 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.disk_cachemodes        = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.disk_prefix            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.enabled_perf_events    = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.file_backed_memory     = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.gid_maps               = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.hw_disk_discard        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.hw_machine_type        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.images_rbd_glance_store_name =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.images_rbd_pool        = rbd {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.images_type            = default {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.images_volume_group    = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.inject_key             = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.inject_partition       = -2 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.inject_password        = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.iscsi_iface            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.iser_use_multipath     = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_bandwidth = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_downtime = 500 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_inbound_addr = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_permit_post_copy = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_scheme  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_timeout_action = abort {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_tunnelled = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: WARNING oslo_config.cfg [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 14:12:35 user nova-compute[74892]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 14:12:35 user nova-compute[74892]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 14:12:35 user nova-compute[74892]: and ``live_migration_inbound_addr`` respectively.
Nov 15 14:12:35 user nova-compute[74892]: ).  Its value may be silently ignored in the future.
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.live_migration_with_native_tls = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.max_queues             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.nfs_mount_options      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.num_memory_encrypted_guests = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.num_pcie_ports         = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.pmem_namespaces        = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.quobyte_client_cfg     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rbd_secret_uuid        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rbd_user               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.remote_filesystem_transport = ssh {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rescue_image_id        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rescue_kernel_id       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rescue_ramdisk_id      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.rx_queue_size          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.smbfs_mount_options    =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.snapshot_compression   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.snapshot_image_format  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.sparse_logical_volumes = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.swtpm_enabled          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.swtpm_group            = tss {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.swtpm_user             = tss {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.sysinfo_serial         = unique {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.tb_cache_size          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.tx_queue_size          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.uid_maps               = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.use_virtio_for_bridges = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.virt_type              = kvm {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.volume_clear           = zero {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.volume_clear_size      = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.volume_use_multipath   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.vzstorage_cache_path   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.vzstorage_mount_user   = stack {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.auth_section           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.auth_type              = password {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.cafile                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.certfile               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.collect_timing         = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.connect_retries        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.connect_retry_delay    = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.default_floating_pool  = public {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.endpoint_override      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.extension_sync_interval = 600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.http_retries           = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.insecure               = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.keyfile                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.max_version            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.min_version            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.ovs_bridge             = br-int {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.physnets               = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.region_name            = RegionOne {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.service_metadata_proxy = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.service_name           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.service_type           = network {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.split_loggers          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.status_code_retries    = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.status_code_retry_delay = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.timeout                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] neutron.version                = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] notifications.bdms_in_notifications = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] notifications.default_level    = INFO {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] notifications.notification_format = unversioned {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] notifications.notify_on_state_change = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] pci.alias                      = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] pci.device_spec                = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] pci.report_in_placement        = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.auth_section         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.auth_type            = password {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.cafile               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.certfile             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.collect_timing       = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.connect_retries      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.connect_retry_delay  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.default_domain_id    = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.default_domain_name  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.domain_id            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.domain_name          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.endpoint_override    = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.insecure             = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.keyfile              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.max_version          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.min_version          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.password             = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.project_domain_id    = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.project_domain_name  = Default {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.project_id           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.project_name         = service {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.region_name          = RegionOne {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.service_name         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.service_type         = placement {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.split_loggers        = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.status_code_retries  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.status_code_retry_delay = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.system_scope         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.timeout              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.trust_id             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.user_domain_id       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.user_domain_name     = Default {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.user_id              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.username             = placement {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] placement.version              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.cores                    = 20 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.count_usage_from_placement = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.injected_file_content_bytes = 10240 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.injected_file_path_length = 255 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.injected_files           = 5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.instances                = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.key_pairs                = 100 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.metadata_items           = 128 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.ram                      = 51200 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.recheck_quota            = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.server_group_members     = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] quota.server_groups            = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] rdp.enabled                    = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.image_metadata_prefilter = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.max_attempts         = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.max_placement_results = 1000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.query_placement_for_image_type_support = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] scheduler.workers              = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.host_subset_size = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.isolated_hosts = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.isolated_images = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.pci_in_placement = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.track_instance_changes = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] metrics.required               = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] metrics.weight_multiplier      = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] metrics.weight_setting         = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] serial_console.enabled         = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] serial_console.port_range      = 10000:20000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] serial_console.serialproxy_port = 6083 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.auth_section      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.auth_type         = password {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.cafile            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.certfile          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.collect_timing    = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.insecure          = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.keyfile           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.send_service_user_token = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.split_loggers     = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] service_user.timeout           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.agent_enabled            = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.enabled                  = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.html5proxy_port          = 6082 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.image_compression        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.jpeg_compression         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.playback_compression     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.server_listen            = 127.0.0.1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.streaming_mode           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] spice.zlib_compression         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] upgrade_levels.baseapi         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] upgrade_levels.cert            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] upgrade_levels.compute         = auto {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] upgrade_levels.conductor       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] upgrade_levels.scheduler       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.auth_section = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.auth_type = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.cafile = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.certfile = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.insecure = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.keyfile = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vendordata_dynamic_auth.timeout = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.api_retry_count         = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.ca_file                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.cache_prefix            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.cluster_name            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.connection_pool_size    = 10 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.console_delay_seconds   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.datastore_regex         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.host_ip                 = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.host_password           = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.host_port               = 443 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.host_username           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.insecure                = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.integration_bridge      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.maximum_objects         = 100 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.pbm_default_policy      = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.pbm_enabled             = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.pbm_wsdl_location       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.serial_port_proxy_uri   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.serial_port_service_uri = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.task_poll_interval      = 0.5 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.use_linked_clone        = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.vnc_keymap              = en-us {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.vnc_port                = 5900 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vmware.vnc_port_total          = 10000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.auth_schemes               = ['none'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.enabled                    = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.novncproxy_port            = 6080 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.server_listen              = 0.0.0.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.vencrypt_ca_certs          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.vencrypt_client_cert       = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vnc.vencrypt_client_key        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.disable_rootwrap   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.enable_numa_live_migration = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.libvirt_disable_apic = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.client_socket_timeout     = 900 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.default_pool_size         = 1000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.keep_alive                = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.max_header_line           = 16384 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.ssl_ca_file               = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.ssl_cert_file             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.ssl_key_file              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.tcp_keepidle              = 600 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] zvm.ca_file                    = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] zvm.cloud_connector_url        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] zvm.reachable_timeout          = 300 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.enforce_new_defaults = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.enforce_scope      = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.policy_default_rule = default {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.policy_file        = policy.yaml {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.connection_string     = messaging:// {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.enabled               = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.es_doc_type           = notification {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.es_scroll_size        = 10000 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.es_scroll_time        = 2m {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.filter_error_trace    = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.hmac_keys             = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.sentinel_service_name = mymaster {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.socket_timeout        = 0.1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.trace_requests        = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler.trace_sqlalchemy      = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler_jaeger.process_tags   = {} {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler_jaeger.service_name_prefix = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] profiler_otlp.service_name_prefix = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] remote_debug.host              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] remote_debug.port              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.ssl      = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_notifications.retry = -1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_messaging_notifications.transport_url = **** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.auth_section        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.auth_type           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.cafile              = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.certfile            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.collect_timing      = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.connect_retries     = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.connect_retry_delay = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.endpoint_id         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.endpoint_override   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.insecure            = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.keyfile             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.max_version         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.min_version         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.region_name         = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.service_name        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.service_type        = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.split_loggers       = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.status_code_retries = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.status_code_retry_delay = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.timeout             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.valid_interfaces    = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_limit.version             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_reports.file_event_handler = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] oslo_reports.log_dir           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_ovs_privileged.group  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] vif_plug_ovs_privileged.user   = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_linux_bridge.flat_interface = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_ovs.isolate_vif         = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_vif_ovs.per_port_bridge     = False {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] os_brick.lock_path             = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] privsep_osbrick.capabilities   = [21] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] privsep_osbrick.group          = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] privsep_osbrick.helper_command = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] privsep_osbrick.user           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] nova_sys_admin.group           = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] nova_sys_admin.helper_command  = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] nova_sys_admin.user            = None {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG oslo_service.service [None req-76e442e5-a51a-4b52-83fa-0ed1bfdebb0f None None] ******************************************************************************** {{(pid=74892) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 14:12:35 user nova-compute[74892]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 14:12:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Connecting to libvirt: qemu:///system {{(pid=74892) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7efd499c6ef0> {{(pid=74892) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 14:12:35 user nova-compute[74892]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 14:12:35 user nova-compute[74892]: WARNING nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 14:12:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7efd499c6ef0> {{(pid=74892) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Starting native event thread {{(pid=74892) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Starting green dispatch thread {{(pid=74892) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 14:12:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Starting connection event dispatch thread {{(pid=74892) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 14:12:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Connection event '1' reason 'None'
Nov 15 14:12:35 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 14:12:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.mount [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Initialising _HostMountState generation 0 {{(pid=74892) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 14:12:42 user nova-compute[74892]: INFO nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host capabilities <capabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <host>
Nov 15 14:12:42 user nova-compute[74892]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 14:12:42 user nova-compute[74892]:     <cpu>
Nov 15 14:12:42 user nova-compute[74892]:       <arch>x86_64</arch>
Nov 15 14:12:42 user nova-compute[74892]:       <model>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <microcode version='1070'/>
Nov 15 14:12:42 user nova-compute[74892]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 14:12:42 user nova-compute[74892]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='osxsave'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='invtsc'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='rsba'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 14:12:42 user nova-compute[74892]:       <pages unit='KiB' size='4'/>
Nov 15 14:12:42 user nova-compute[74892]:       <pages unit='KiB' size='2048'/>
Nov 15 14:12:42 user nova-compute[74892]:     </cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <power_management>
Nov 15 14:12:42 user nova-compute[74892]:       <suspend_mem/>
Nov 15 14:12:42 user nova-compute[74892]:       <suspend_disk/>
Nov 15 14:12:42 user nova-compute[74892]:       <suspend_hybrid/>
Nov 15 14:12:42 user nova-compute[74892]:     </power_management>
Nov 15 14:12:42 user nova-compute[74892]:     <iommu support='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <migration_features>
Nov 15 14:12:42 user nova-compute[74892]:       <live/>
Nov 15 14:12:42 user nova-compute[74892]:       <uri_transports>
Nov 15 14:12:42 user nova-compute[74892]:         <uri_transport>tcp</uri_transport>
Nov 15 14:12:42 user nova-compute[74892]:         <uri_transport>rdma</uri_transport>
Nov 15 14:12:42 user nova-compute[74892]:       </uri_transports>
Nov 15 14:12:42 user nova-compute[74892]:     </migration_features>
Nov 15 14:12:42 user nova-compute[74892]:     <topology>
Nov 15 14:12:42 user nova-compute[74892]:       <cells num='2'>
Nov 15 14:12:42 user nova-compute[74892]:         <cell id='0'>
Nov 15 14:12:42 user nova-compute[74892]:           <memory unit='KiB'>8189224</memory>
Nov 15 14:12:42 user nova-compute[74892]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 15 14:12:42 user nova-compute[74892]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 14:12:42 user nova-compute[74892]:           <distances>
Nov 15 14:12:42 user nova-compute[74892]:             <sibling id='0' value='10'/>
Nov 15 14:12:42 user nova-compute[74892]:             <sibling id='1' value='20'/>
Nov 15 14:12:42 user nova-compute[74892]:           </distances>
Nov 15 14:12:42 user nova-compute[74892]:           <cpus num='6'>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 14:12:42 user nova-compute[74892]:           </cpus>
Nov 15 14:12:42 user nova-compute[74892]:         </cell>
Nov 15 14:12:42 user nova-compute[74892]:         <cell id='1'>
Nov 15 14:12:42 user nova-compute[74892]:           <memory unit='KiB'>8206460</memory>
Nov 15 14:12:42 user nova-compute[74892]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 15 14:12:42 user nova-compute[74892]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 14:12:42 user nova-compute[74892]:           <distances>
Nov 15 14:12:42 user nova-compute[74892]:             <sibling id='0' value='20'/>
Nov 15 14:12:42 user nova-compute[74892]:             <sibling id='1' value='10'/>
Nov 15 14:12:42 user nova-compute[74892]:           </distances>
Nov 15 14:12:42 user nova-compute[74892]:           <cpus num='6'>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 14:12:42 user nova-compute[74892]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 14:12:42 user nova-compute[74892]:           </cpus>
Nov 15 14:12:42 user nova-compute[74892]:         </cell>
Nov 15 14:12:42 user nova-compute[74892]:       </cells>
Nov 15 14:12:42 user nova-compute[74892]:     </topology>
Nov 15 14:12:42 user nova-compute[74892]:     <cache>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 14:12:42 user nova-compute[74892]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 14:12:42 user nova-compute[74892]:     </cache>
Nov 15 14:12:42 user nova-compute[74892]:     <secmodel>
Nov 15 14:12:42 user nova-compute[74892]:       <model>apparmor</model>
Nov 15 14:12:42 user nova-compute[74892]:       <doi>0</doi>
Nov 15 14:12:42 user nova-compute[74892]:     </secmodel>
Nov 15 14:12:42 user nova-compute[74892]:     <secmodel>
Nov 15 14:12:42 user nova-compute[74892]:       <model>dac</model>
Nov 15 14:12:42 user nova-compute[74892]:       <doi>0</doi>
Nov 15 14:12:42 user nova-compute[74892]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 14:12:42 user nova-compute[74892]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 14:12:42 user nova-compute[74892]:     </secmodel>
Nov 15 14:12:42 user nova-compute[74892]:   </host>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='alpha'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>clipper</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='armv6l'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>spitz</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>nuri</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>kzm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sx1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>z2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>tosa</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>n810</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>n800</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>terrier</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>midway</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>microbit</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>verdex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>highbank</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>akita</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>connex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>collie</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='armv7l'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>spitz</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>nuri</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>kzm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sx1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>z2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>tosa</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>n810</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>n800</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>terrier</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>midway</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>microbit</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>verdex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>highbank</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>akita</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>connex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>collie</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='aarch64'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>spitz</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>nuri</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>kzm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sx1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>z2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>tosa</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>n810</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>n800</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>terrier</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>midway</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>microbit</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>verdex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>highbank</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>akita</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>connex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>collie</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <acpi default='on' toggle='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='cris'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='i686'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>isapc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>microvm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='kvm'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <pae/>
Nov 15 14:12:42 user nova-compute[74892]:       <nonpae/>
Nov 15 14:12:42 user nova-compute[74892]:       <acpi default='on' toggle='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:       <apic default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='m68k'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>an5206</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>q800</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='microblaze'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='microblazeel'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='mips'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='16'>malta</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='mipsel'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='16'>malta</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='mips64'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='16'>malta</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>pica61</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>magnum</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='mips64el'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='16'>malta</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>pica61</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>magnum</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='16'>boston</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='ppc'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mac99</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>40p</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>taihu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='ppc64'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>taihu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>40p</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mac99</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='ppc64le'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>taihu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>40p</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>mac99</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='riscv32'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='8'>spike</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='8'>virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='riscv64'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='8'>spike</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='8'>virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='s390x'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='sh4'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>shix</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>r2d</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='sh4eb'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>shix</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>r2d</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='sparc'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>LX</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='sparc64'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>niagara</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='x86_64'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>64</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='1'>isapc</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>microvm</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='kvm'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <acpi default='on' toggle='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:       <apic default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='xtensa'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>sim</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>kc705</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>ml605</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>lx200</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>lx60</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]:   <guest>
Nov 15 14:12:42 user nova-compute[74892]:     <os_type>hvm</os_type>
Nov 15 14:12:42 user nova-compute[74892]:     <arch name='xtensaeb'>
Nov 15 14:12:42 user nova-compute[74892]:       <wordsize>32</wordsize>
Nov 15 14:12:42 user nova-compute[74892]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='4'>sim</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>kc705</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>ml605</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>virt</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>lx200</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>lx60</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 14:12:42 user nova-compute[74892]:       <domain type='qemu'/>
Nov 15 14:12:42 user nova-compute[74892]:     </arch>
Nov 15 14:12:42 user nova-compute[74892]:     <features>
Nov 15 14:12:42 user nova-compute[74892]:       <cpuselection/>
Nov 15 14:12:42 user nova-compute[74892]:       <deviceboot/>
Nov 15 14:12:42 user nova-compute[74892]:       <disksnapshot default='on' toggle='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     </features>
Nov 15 14:12:42 user nova-compute[74892]:   </guest>
Nov 15 14:12:42 user nova-compute[74892]: </capabilities>
Nov 15 14:12:42 user nova-compute[74892]: 
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 14:12:42 user nova-compute[74892]: <domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 14:12:42 user nova-compute[74892]:   <domain>kvm</domain>
Nov 15 14:12:42 user nova-compute[74892]:   <machine>pc-i440fx-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:   <arch>i686</arch>
Nov 15 14:12:42 user nova-compute[74892]:   <vcpu max='255'/>
Nov 15 14:12:42 user nova-compute[74892]:   <iothreads supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:   <os supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='firmware'/>
Nov 15 14:12:42 user nova-compute[74892]:     <loader supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>rom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pflash</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='readonly'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='secure'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </loader>
Nov 15 14:12:42 user nova-compute[74892]:   </os>
Nov 15 14:12:42 user nova-compute[74892]:   <cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-passthrough' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='hostPassthroughMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='maximum' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='maximumMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-model' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='umip'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibpb'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibrs'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='erms'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='lm'/>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='custom' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>qemu64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>qemu32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>phenom</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>n270</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>kvm64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>coreduo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>core2duo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>athlon</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Westmere</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Snowridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Penryn</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G5</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G4</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G1</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Rome</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Milan</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Dhyana</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cooperlake</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Conroe</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>486</model>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:   </cpu>
Nov 15 14:12:42 user nova-compute[74892]:   <memoryBacking supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='sourceType'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>file</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>anonymous</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>memfd</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:   </memoryBacking>
Nov 15 14:12:42 user nova-compute[74892]:   <devices>
Nov 15 14:12:42 user nova-compute[74892]:     <disk supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='diskDevice'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>disk</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cdrom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>floppy</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>lun</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='bus'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ide</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>fdc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sata</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </disk>
Nov 15 14:12:42 user nova-compute[74892]:     <graphics supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sdl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vnc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>spice</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egl-headless</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </graphics>
Nov 15 14:12:42 user nova-compute[74892]:     <video supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='modelType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cirrus</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vmvga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>qxl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>none</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>bochs</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ramfb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </video>
Nov 15 14:12:42 user nova-compute[74892]:     <hostdev supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='mode'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>subsystem</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='startupPolicy'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>default</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>mandatory</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>requisite</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>optional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='subsysType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pci</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='capsType'/>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='pciBackend'/>
Nov 15 14:12:42 user nova-compute[74892]:     </hostdev>
Nov 15 14:12:42 user nova-compute[74892]:     <rng supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>random</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egd</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>builtin</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </rng>
Nov 15 14:12:42 user nova-compute[74892]:     <filesystem supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='driverType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>path</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>handle</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtiofs</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </filesystem>
Nov 15 14:12:42 user nova-compute[74892]:     <tpm supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-tis</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-crb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>passthrough</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>emulator</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </tpm>
Nov 15 14:12:42 user nova-compute[74892]:   </devices>
Nov 15 14:12:42 user nova-compute[74892]:   <features>
Nov 15 14:12:42 user nova-compute[74892]:     <gic supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <vmcoreinfo supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <genid supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backingStoreInput supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backup supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <sev supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:   </features>
Nov 15 14:12:42 user nova-compute[74892]: </domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 14:12:42 user nova-compute[74892]: <domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 14:12:42 user nova-compute[74892]:   <domain>kvm</domain>
Nov 15 14:12:42 user nova-compute[74892]:   <machine>pc-i440fx-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:   <arch>i686</arch>
Nov 15 14:12:42 user nova-compute[74892]:   <vcpu max='255'/>
Nov 15 14:12:42 user nova-compute[74892]:   <iothreads supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:   <os supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='firmware'/>
Nov 15 14:12:42 user nova-compute[74892]:     <loader supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>rom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pflash</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='readonly'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='secure'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </loader>
Nov 15 14:12:42 user nova-compute[74892]:   </os>
Nov 15 14:12:42 user nova-compute[74892]:   <cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-passthrough' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='hostPassthroughMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='maximum' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='maximumMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-model' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='umip'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibpb'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibrs'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='erms'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='lm'/>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='custom' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>qemu64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>qemu32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>phenom</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>n270</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>kvm64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>coreduo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>core2duo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>athlon</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Westmere</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Snowridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Penryn</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G5</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G4</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G1</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Rome</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Milan</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Dhyana</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cooperlake</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Conroe</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>486</model>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:   </cpu>
Nov 15 14:12:42 user nova-compute[74892]:   <memoryBacking supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='sourceType'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>file</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>anonymous</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>memfd</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:   </memoryBacking>
Nov 15 14:12:42 user nova-compute[74892]:   <devices>
Nov 15 14:12:42 user nova-compute[74892]:     <disk supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='diskDevice'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>disk</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cdrom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>floppy</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>lun</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='bus'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ide</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>fdc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sata</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </disk>
Nov 15 14:12:42 user nova-compute[74892]:     <graphics supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sdl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vnc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>spice</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egl-headless</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </graphics>
Nov 15 14:12:42 user nova-compute[74892]:     <video supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='modelType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cirrus</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vmvga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>qxl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>none</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>bochs</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ramfb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </video>
Nov 15 14:12:42 user nova-compute[74892]:     <hostdev supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='mode'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>subsystem</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='startupPolicy'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>default</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>mandatory</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>requisite</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>optional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='subsysType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pci</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='capsType'/>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='pciBackend'/>
Nov 15 14:12:42 user nova-compute[74892]:     </hostdev>
Nov 15 14:12:42 user nova-compute[74892]:     <rng supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>random</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egd</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>builtin</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </rng>
Nov 15 14:12:42 user nova-compute[74892]:     <filesystem supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='driverType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>path</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>handle</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtiofs</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </filesystem>
Nov 15 14:12:42 user nova-compute[74892]:     <tpm supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-tis</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-crb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>passthrough</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>emulator</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </tpm>
Nov 15 14:12:42 user nova-compute[74892]:   </devices>
Nov 15 14:12:42 user nova-compute[74892]:   <features>
Nov 15 14:12:42 user nova-compute[74892]:     <gic supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <vmcoreinfo supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <genid supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backingStoreInput supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backup supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <sev supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:   </features>
Nov 15 14:12:42 user nova-compute[74892]: </domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 14:12:42 user nova-compute[74892]: <domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 14:12:42 user nova-compute[74892]:   <domain>kvm</domain>
Nov 15 14:12:42 user nova-compute[74892]:   <machine>pc-q35-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:   <arch>i686</arch>
Nov 15 14:12:42 user nova-compute[74892]:   <vcpu max='288'/>
Nov 15 14:12:42 user nova-compute[74892]:   <iothreads supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:   <os supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='firmware'/>
Nov 15 14:12:42 user nova-compute[74892]:     <loader supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>rom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pflash</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='readonly'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='secure'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </loader>
Nov 15 14:12:42 user nova-compute[74892]:   </os>
Nov 15 14:12:42 user nova-compute[74892]:   <cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-passthrough' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='hostPassthroughMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='maximum' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='maximumMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-model' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='umip'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibpb'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibrs'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='erms'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='lm'/>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='custom' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>qemu64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>qemu32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>phenom</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>n270</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>kvm64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>coreduo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>core2duo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>athlon</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Westmere</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Snowridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Penryn</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G5</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G4</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G1</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Rome</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Milan</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Dhyana</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cooperlake</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Conroe</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>486</model>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:   </cpu>
Nov 15 14:12:42 user nova-compute[74892]:   <memoryBacking supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='sourceType'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>file</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>anonymous</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>memfd</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:   </memoryBacking>
Nov 15 14:12:42 user nova-compute[74892]:   <devices>
Nov 15 14:12:42 user nova-compute[74892]:     <disk supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='diskDevice'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>disk</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cdrom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>floppy</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>lun</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='bus'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>fdc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sata</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </disk>
Nov 15 14:12:42 user nova-compute[74892]:     <graphics supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sdl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vnc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>spice</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egl-headless</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </graphics>
Nov 15 14:12:42 user nova-compute[74892]:     <video supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='modelType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cirrus</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vmvga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>qxl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>none</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>bochs</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ramfb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </video>
Nov 15 14:12:42 user nova-compute[74892]:     <hostdev supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='mode'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>subsystem</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='startupPolicy'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>default</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>mandatory</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>requisite</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>optional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='subsysType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pci</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='capsType'/>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='pciBackend'/>
Nov 15 14:12:42 user nova-compute[74892]:     </hostdev>
Nov 15 14:12:42 user nova-compute[74892]:     <rng supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>random</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egd</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>builtin</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </rng>
Nov 15 14:12:42 user nova-compute[74892]:     <filesystem supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='driverType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>path</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>handle</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtiofs</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </filesystem>
Nov 15 14:12:42 user nova-compute[74892]:     <tpm supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-tis</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-crb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>passthrough</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>emulator</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </tpm>
Nov 15 14:12:42 user nova-compute[74892]:   </devices>
Nov 15 14:12:42 user nova-compute[74892]:   <features>
Nov 15 14:12:42 user nova-compute[74892]:     <gic supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <vmcoreinfo supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <genid supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backingStoreInput supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backup supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <sev supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:   </features>
Nov 15 14:12:42 user nova-compute[74892]: </domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 14:12:42 user nova-compute[74892]: <domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 14:12:42 user nova-compute[74892]:   <domain>kvm</domain>
Nov 15 14:12:42 user nova-compute[74892]:   <machine>pc-q35-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:   <arch>i686</arch>
Nov 15 14:12:42 user nova-compute[74892]:   <vcpu max='288'/>
Nov 15 14:12:42 user nova-compute[74892]:   <iothreads supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:   <os supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='firmware'/>
Nov 15 14:12:42 user nova-compute[74892]:     <loader supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>rom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pflash</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='readonly'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='secure'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </loader>
Nov 15 14:12:42 user nova-compute[74892]:   </os>
Nov 15 14:12:42 user nova-compute[74892]:   <cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-passthrough' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='hostPassthroughMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='maximum' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='maximumMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-model' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='umip'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibpb'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibrs'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='erms'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='lm'/>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='custom' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>qemu64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>qemu32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>phenom</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>n270</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>kvm64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>coreduo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>core2duo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>athlon</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Westmere</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Snowridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Penryn</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G5</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G4</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G1</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Rome</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Milan</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Dhyana</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cooperlake</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Conroe</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>486</model>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:   </cpu>
Nov 15 14:12:42 user nova-compute[74892]:   <memoryBacking supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='sourceType'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>file</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>anonymous</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>memfd</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:   </memoryBacking>
Nov 15 14:12:42 user nova-compute[74892]:   <devices>
Nov 15 14:12:42 user nova-compute[74892]:     <disk supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='diskDevice'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>disk</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cdrom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>floppy</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>lun</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='bus'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>fdc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sata</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </disk>
Nov 15 14:12:42 user nova-compute[74892]:     <graphics supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sdl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vnc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>spice</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egl-headless</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </graphics>
Nov 15 14:12:42 user nova-compute[74892]:     <video supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='modelType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cirrus</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vmvga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>qxl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>none</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>bochs</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ramfb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </video>
Nov 15 14:12:42 user nova-compute[74892]:     <hostdev supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='mode'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>subsystem</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='startupPolicy'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>default</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>mandatory</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>requisite</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>optional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='subsysType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pci</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='capsType'/>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='pciBackend'/>
Nov 15 14:12:42 user nova-compute[74892]:     </hostdev>
Nov 15 14:12:42 user nova-compute[74892]:     <rng supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>random</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egd</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>builtin</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </rng>
Nov 15 14:12:42 user nova-compute[74892]:     <filesystem supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='driverType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>path</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>handle</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtiofs</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </filesystem>
Nov 15 14:12:42 user nova-compute[74892]:     <tpm supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-tis</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-crb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>passthrough</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>emulator</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </tpm>
Nov 15 14:12:42 user nova-compute[74892]:   </devices>
Nov 15 14:12:42 user nova-compute[74892]:   <features>
Nov 15 14:12:42 user nova-compute[74892]:     <gic supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <vmcoreinfo supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <genid supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backingStoreInput supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backup supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <sev supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:   </features>
Nov 15 14:12:42 user nova-compute[74892]: </domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 14:12:42 user nova-compute[74892]: <domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 14:12:42 user nova-compute[74892]:   <domain>kvm</domain>
Nov 15 14:12:42 user nova-compute[74892]:   <machine>pc-i440fx-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:   <arch>x86_64</arch>
Nov 15 14:12:42 user nova-compute[74892]:   <vcpu max='255'/>
Nov 15 14:12:42 user nova-compute[74892]:   <iothreads supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:   <os supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='firmware'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>efi</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:     <loader supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>rom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pflash</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='readonly'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='secure'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </loader>
Nov 15 14:12:42 user nova-compute[74892]:   </os>
Nov 15 14:12:42 user nova-compute[74892]:   <cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-passthrough' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='hostPassthroughMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='maximum' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='maximumMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-model' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='umip'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='invtsc'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibpb'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibrs'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='rsba'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='erms'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='custom' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>qemu64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>qemu32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>phenom</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>n270</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>coreduo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>core2duo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>athlon</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Westmere</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Snowridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Penryn</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G5</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G4</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Opteron_G1</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Rome</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Milan</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Dhyana</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cooperlake</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Conroe</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>486</model>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:   </cpu>
Nov 15 14:12:42 user nova-compute[74892]:   <memoryBacking supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='sourceType'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>file</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>anonymous</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>memfd</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:   </memoryBacking>
Nov 15 14:12:42 user nova-compute[74892]:   <devices>
Nov 15 14:12:42 user nova-compute[74892]:     <disk supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='diskDevice'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>disk</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cdrom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>floppy</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>lun</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='bus'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ide</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>fdc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sata</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </disk>
Nov 15 14:12:42 user nova-compute[74892]:     <graphics supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sdl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vnc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>spice</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egl-headless</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </graphics>
Nov 15 14:12:42 user nova-compute[74892]:     <video supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='modelType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cirrus</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vmvga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>qxl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>none</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>bochs</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ramfb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </video>
Nov 15 14:12:42 user nova-compute[74892]:     <hostdev supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='mode'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>subsystem</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='startupPolicy'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>default</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>mandatory</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>requisite</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>optional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='subsysType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pci</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='capsType'/>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='pciBackend'/>
Nov 15 14:12:42 user nova-compute[74892]:     </hostdev>
Nov 15 14:12:42 user nova-compute[74892]:     <rng supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>random</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egd</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>builtin</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </rng>
Nov 15 14:12:42 user nova-compute[74892]:     <filesystem supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='driverType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>path</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>handle</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtiofs</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </filesystem>
Nov 15 14:12:42 user nova-compute[74892]:     <tpm supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-tis</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-crb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>passthrough</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>emulator</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </tpm>
Nov 15 14:12:42 user nova-compute[74892]:   </devices>
Nov 15 14:12:42 user nova-compute[74892]:   <features>
Nov 15 14:12:42 user nova-compute[74892]:     <gic supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <vmcoreinfo supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <genid supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backingStoreInput supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backup supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <sev supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:   </features>
Nov 15 14:12:42 user nova-compute[74892]: </domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 14:12:42 user nova-compute[74892]: <domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 14:12:42 user nova-compute[74892]:   <domain>kvm</domain>
Nov 15 14:12:42 user nova-compute[74892]:   <machine>pc-i440fx-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:   <arch>x86_64</arch>
Nov 15 14:12:42 user nova-compute[74892]:   <vcpu max='255'/>
Nov 15 14:12:42 user nova-compute[74892]:   <iothreads supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:   <os supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='firmware'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>efi</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:     <loader supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>rom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pflash</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='readonly'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='secure'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </loader>
Nov 15 14:12:42 user nova-compute[74892]:   </os>
Nov 15 14:12:42 user nova-compute[74892]:   <cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-passthrough' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='hostPassthroughMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='maximum' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='maximumMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-model' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='umip'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='invtsc'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibpb'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibrs'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='rsba'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='erms'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='custom' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>qemu64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>qemu32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>phenom</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>n270</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>coreduo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>core2duo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>athlon</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Westmere</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Snowridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Penryn</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G5</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G4</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Opteron_G1</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Rome</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Milan</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Dhyana</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cooperlake</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Conroe</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>486</model>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:   </cpu>
Nov 15 14:12:42 user nova-compute[74892]:   <memoryBacking supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='sourceType'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>file</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>anonymous</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>memfd</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:   </memoryBacking>
Nov 15 14:12:42 user nova-compute[74892]:   <devices>
Nov 15 14:12:42 user nova-compute[74892]:     <disk supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='diskDevice'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>disk</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cdrom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>floppy</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>lun</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='bus'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ide</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>fdc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sata</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </disk>
Nov 15 14:12:42 user nova-compute[74892]:     <graphics supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sdl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vnc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>spice</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egl-headless</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </graphics>
Nov 15 14:12:42 user nova-compute[74892]:     <video supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='modelType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cirrus</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vmvga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>qxl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>none</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>bochs</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ramfb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </video>
Nov 15 14:12:42 user nova-compute[74892]:     <hostdev supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='mode'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>subsystem</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='startupPolicy'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>default</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>mandatory</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>requisite</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>optional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='subsysType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pci</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='capsType'/>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='pciBackend'/>
Nov 15 14:12:42 user nova-compute[74892]:     </hostdev>
Nov 15 14:12:42 user nova-compute[74892]:     <rng supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>random</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egd</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>builtin</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </rng>
Nov 15 14:12:42 user nova-compute[74892]:     <filesystem supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='driverType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>path</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>handle</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtiofs</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </filesystem>
Nov 15 14:12:42 user nova-compute[74892]:     <tpm supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-tis</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-crb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>passthrough</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>emulator</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </tpm>
Nov 15 14:12:42 user nova-compute[74892]:   </devices>
Nov 15 14:12:42 user nova-compute[74892]:   <features>
Nov 15 14:12:42 user nova-compute[74892]:     <gic supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <vmcoreinfo supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <genid supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backingStoreInput supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backup supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <sev supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:   </features>
Nov 15 14:12:42 user nova-compute[74892]: </domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 14:12:42 user nova-compute[74892]: <domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 14:12:42 user nova-compute[74892]:   <domain>kvm</domain>
Nov 15 14:12:42 user nova-compute[74892]:   <machine>pc-q35-jammy</machine>
Nov 15 14:12:42 user nova-compute[74892]:   <arch>x86_64</arch>
Nov 15 14:12:42 user nova-compute[74892]:   <vcpu max='288'/>
Nov 15 14:12:42 user nova-compute[74892]:   <iothreads supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:   <os supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='firmware'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>efi</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:     <loader supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>rom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pflash</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='readonly'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='secure'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </loader>
Nov 15 14:12:42 user nova-compute[74892]:   </os>
Nov 15 14:12:42 user nova-compute[74892]:   <cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-passthrough' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='hostPassthroughMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='maximum' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='maximumMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-model' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='umip'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='invtsc'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibpb'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibrs'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='rsba'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='erms'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='custom' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>qemu64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>qemu32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>phenom</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>n270</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>coreduo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>core2duo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>athlon</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Westmere</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Snowridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Penryn</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G5</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G4</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Opteron_G1</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Rome</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Milan</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Dhyana</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cooperlake</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Conroe</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>486</model>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:   </cpu>
Nov 15 14:12:42 user nova-compute[74892]:   <memoryBacking supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='sourceType'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>file</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>anonymous</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>memfd</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:   </memoryBacking>
Nov 15 14:12:42 user nova-compute[74892]:   <devices>
Nov 15 14:12:42 user nova-compute[74892]:     <disk supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='diskDevice'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>disk</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cdrom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>floppy</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>lun</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='bus'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>fdc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sata</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </disk>
Nov 15 14:12:42 user nova-compute[74892]:     <graphics supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sdl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vnc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>spice</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egl-headless</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </graphics>
Nov 15 14:12:42 user nova-compute[74892]:     <video supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='modelType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cirrus</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vmvga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>qxl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>none</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>bochs</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ramfb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </video>
Nov 15 14:12:42 user nova-compute[74892]:     <hostdev supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='mode'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>subsystem</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='startupPolicy'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>default</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>mandatory</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>requisite</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>optional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='subsysType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pci</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='capsType'/>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='pciBackend'/>
Nov 15 14:12:42 user nova-compute[74892]:     </hostdev>
Nov 15 14:12:42 user nova-compute[74892]:     <rng supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>random</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egd</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>builtin</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </rng>
Nov 15 14:12:42 user nova-compute[74892]:     <filesystem supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='driverType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>path</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>handle</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtiofs</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </filesystem>
Nov 15 14:12:42 user nova-compute[74892]:     <tpm supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-tis</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-crb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>passthrough</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>emulator</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </tpm>
Nov 15 14:12:42 user nova-compute[74892]:   </devices>
Nov 15 14:12:42 user nova-compute[74892]:   <features>
Nov 15 14:12:42 user nova-compute[74892]:     <gic supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <vmcoreinfo supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <genid supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backingStoreInput supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backup supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <sev supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:   </features>
Nov 15 14:12:42 user nova-compute[74892]: </domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 14:12:42 user nova-compute[74892]: <domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 14:12:42 user nova-compute[74892]:   <domain>kvm</domain>
Nov 15 14:12:42 user nova-compute[74892]:   <machine>pc-q35-6.2</machine>
Nov 15 14:12:42 user nova-compute[74892]:   <arch>x86_64</arch>
Nov 15 14:12:42 user nova-compute[74892]:   <vcpu max='288'/>
Nov 15 14:12:42 user nova-compute[74892]:   <iothreads supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:   <os supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='firmware'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>efi</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:     <loader supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>rom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pflash</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='readonly'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='secure'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>yes</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>no</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </loader>
Nov 15 14:12:42 user nova-compute[74892]:   </os>
Nov 15 14:12:42 user nova-compute[74892]:   <cpu>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-passthrough' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='hostPassthroughMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='maximum' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='maximumMigratable'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>on</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>off</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='host-model' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <vendor>Intel</vendor>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ss'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='vmx'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pcid'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='hypervisor'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arat'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='umip'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='md-clear'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='invtsc'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibpb'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='ibrs'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-stibp'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='rsba'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='erms'/>
Nov 15 14:12:42 user nova-compute[74892]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:     <mode name='custom' supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>qemu64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>qemu32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>phenom</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>pentium</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>n270</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm64</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>kvm32</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>coreduo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>core2duo</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>athlon</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Westmere</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Snowridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Skylake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>SandyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Penryn</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G5</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G4</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G3</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Opteron_G2</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Opteron_G1</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>IvyBridge</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Icelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Haswell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Rome</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-Milan</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>EPYC</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Dhyana</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cooperlake</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>Conroe</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='no'>Broadwell</model>
Nov 15 14:12:42 user nova-compute[74892]:       <model usable='yes'>486</model>
Nov 15 14:12:42 user nova-compute[74892]:     </mode>
Nov 15 14:12:42 user nova-compute[74892]:   </cpu>
Nov 15 14:12:42 user nova-compute[74892]:   <memoryBacking supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:     <enum name='sourceType'>
Nov 15 14:12:42 user nova-compute[74892]:       <value>file</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>anonymous</value>
Nov 15 14:12:42 user nova-compute[74892]:       <value>memfd</value>
Nov 15 14:12:42 user nova-compute[74892]:     </enum>
Nov 15 14:12:42 user nova-compute[74892]:   </memoryBacking>
Nov 15 14:12:42 user nova-compute[74892]:   <devices>
Nov 15 14:12:42 user nova-compute[74892]:     <disk supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='diskDevice'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>disk</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cdrom</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>floppy</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>lun</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='bus'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>fdc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sata</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </disk>
Nov 15 14:12:42 user nova-compute[74892]:     <graphics supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='type'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>sdl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vnc</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>spice</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egl-headless</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </graphics>
Nov 15 14:12:42 user nova-compute[74892]:     <video supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='modelType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>cirrus</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>vmvga</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>qxl</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>none</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>bochs</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>ramfb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </video>
Nov 15 14:12:42 user nova-compute[74892]:     <hostdev supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='mode'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>subsystem</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='startupPolicy'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>default</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>mandatory</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>requisite</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>optional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='subsysType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>usb</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>pci</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>scsi</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='capsType'/>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='pciBackend'/>
Nov 15 14:12:42 user nova-compute[74892]:     </hostdev>
Nov 15 14:12:42 user nova-compute[74892]:     <rng supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtio-non-transitional</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>random</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>egd</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>builtin</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </rng>
Nov 15 14:12:42 user nova-compute[74892]:     <filesystem supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='driverType'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>path</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>handle</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>virtiofs</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </filesystem>
Nov 15 14:12:42 user nova-compute[74892]:     <tpm supported='yes'>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='model'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-tis</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>tpm-crb</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:       <enum name='backendModel'>
Nov 15 14:12:42 user nova-compute[74892]:         <value>passthrough</value>
Nov 15 14:12:42 user nova-compute[74892]:         <value>emulator</value>
Nov 15 14:12:42 user nova-compute[74892]:       </enum>
Nov 15 14:12:42 user nova-compute[74892]:     </tpm>
Nov 15 14:12:42 user nova-compute[74892]:   </devices>
Nov 15 14:12:42 user nova-compute[74892]:   <features>
Nov 15 14:12:42 user nova-compute[74892]:     <gic supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:     <vmcoreinfo supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <genid supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backingStoreInput supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <backup supported='yes'/>
Nov 15 14:12:42 user nova-compute[74892]:     <sev supported='no'/>
Nov 15 14:12:42 user nova-compute[74892]:   </features>
Nov 15 14:12:42 user nova-compute[74892]: </domainCapabilities>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74892) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74892) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74892) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74892) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74892) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74892) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74892) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 14:12:42 user nova-compute[74892]: INFO nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Secure Boot support detected
Nov 15 14:12:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] cpu compare xml: <cpu match="exact">
Nov 15 14:12:42 user nova-compute[74892]:   <model>Nehalem</model>
Nov 15 14:12:42 user nova-compute[74892]: </cpu>
Nov 15 14:12:42 user nova-compute[74892]:  {{(pid=74892) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 14:12:42 user nova-compute[74892]: INFO nova.virt.node [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Generated node identity f0684847-d6be-43f9-9eb9-f058843467dc
Nov 15 14:12:42 user nova-compute[74892]: INFO nova.virt.node [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Wrote node identity f0684847-d6be-43f9-9eb9-f058843467dc to /opt/stack/data/nova/compute_id
Nov 15 14:12:42 user nova-compute[74892]: WARNING nova.compute.manager [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Compute nodes ['f0684847-d6be-43f9-9eb9-f058843467dc'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 14:12:42 user nova-compute[74892]: INFO nova.compute.manager [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 14:12:43 user nova-compute[74892]: WARNING nova.compute.manager [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 14:12:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:12:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:12:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Hypervisor/Node resource view: name=user free_ram=10958MB free_disk=26.112762451171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:12:43 user nova-compute[74892]: WARNING nova.compute.resource_tracker [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] No compute node record for user:f0684847-d6be-43f9-9eb9-f058843467dc: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f0684847-d6be-43f9-9eb9-f058843467dc could not be found.
Nov 15 14:12:43 user nova-compute[74892]: INFO nova.compute.resource_tracker [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Compute node record created for user:user with uuid: f0684847-d6be-43f9-9eb9-f058843467dc
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:12:43 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] [req-f1939ed2-f512-4bcd-96e5-37f4971c7997] Created resource provider record via placement API for resource provider with UUID f0684847-d6be-43f9-9eb9-f058843467dc and name user.
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74892) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 14:12:43 user nova-compute[74892]: INFO nova.virt.libvirt.host [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] kernel doesn't support AMD SEV
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Libvirt baseline CPU <cpu>
Nov 15 14:12:43 user nova-compute[74892]:   <arch>x86_64</arch>
Nov 15 14:12:43 user nova-compute[74892]:   <model>Nehalem</model>
Nov 15 14:12:43 user nova-compute[74892]:   <vendor>Intel</vendor>
Nov 15 14:12:43 user nova-compute[74892]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 14:12:43 user nova-compute[74892]: </cpu>
Nov 15 14:12:43 user nova-compute[74892]:  {{(pid=74892) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Updated inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Updating resource provider f0684847-d6be-43f9-9eb9-f058843467dc generation from 0 to 1 during operation: update_inventory {{(pid=74892) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Updating resource provider f0684847-d6be-43f9-9eb9-f058843467dc generation from 1 to 2 during operation: update_traits {{(pid=74892) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.629s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.service [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Creating RPC server for service compute {{(pid=74892) start /opt/stack/nova/nova/service.py:182}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.service [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] Join ServiceGroup membership for this service compute {{(pid=74892) start /opt/stack/nova/nova/service.py:199}}
Nov 15 14:12:43 user nova-compute[74892]: DEBUG nova.servicegroup.drivers.db [None req-ec291608-a91d-40f7-af73-558e8b35f1d9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74892) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 14:13:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:13:34 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:13:35 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:13:35 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:13:35 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=10399MB free_disk=26.01653289794922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:13:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:13:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:13:35 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:13:35 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:13:35 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:13:35 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:13:35 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:13:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:14:35 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:14:36 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:14:36 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:14:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=10327MB free_disk=26.08099365234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:14:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:14:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:14:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:14:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:14:36 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:14:36 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:14:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:14:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:14:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:14:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:15:35 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:15:36 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:15:36 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:15:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=10364MB free_disk=25.833370208740234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:15:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:15:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:15:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:15:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:15:36 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:15:36 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:15:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:15:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:15:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:15:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:15:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:16:37 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:16:37 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:16:37 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9652MB free_disk=25.861560821533203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:16:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:37 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:16:37 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:16:37 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:16:37 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:16:37 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:16:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:38 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:16:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:39 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:39 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:16:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:16:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:41 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:16:41 user nova-compute[74892]: INFO nova.compute.claims [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Claim successful on node user
Nov 15 14:16:41 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:16:41 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:16:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:16:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:16:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Creating image(s)
Nov 15 14:16:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "/opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "/opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "/opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG nova.policy [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eccd14bd0c974f4a83aba63fd70df073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcc169292ce42fb9f54aab1db3869bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG nova.virt.images [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] 557dbecf-dbbd-46c7-999f-66066c1bea36 was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e.part /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e.part /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e.converted" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.463s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:43 user nova-compute[74892]: INFO oslo.privsep.daemon [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpohae5tk_/privsep.sock']
Nov 15 14:16:43 user sudo[84129]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpohae5tk_/privsep.sock
Nov 15 14:16:43 user sudo[84129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 14:16:45 user sudo[84129]: pam_unix(sudo:session): session closed for user root
Nov 15 14:16:45 user nova-compute[74892]: INFO oslo.privsep.daemon [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Spawned new privsep daemon via rootwrap
Nov 15 14:16:45 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 14:16:45 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 14:16:45 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 14:16:45 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84154
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk 1073741824" returned: 0 in 0.045s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Successfully created port: cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:16:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:46 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Cannot resize image /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:16:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:16:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Ensure instance console log exists: /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:16:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Successfully updated port: cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:16:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:16:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquired lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:16:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:16:50 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:16:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-c8919ae0-949b-4008-bc23-1be6222a9c02 req-44d91af1-d641-482a-b460-10ba255c0363 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received event network-changed-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:16:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-c8919ae0-949b-4008-bc23-1be6222a9c02 req-44d91af1-d641-482a-b460-10ba255c0363 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Refreshing instance network info cache due to event network-changed-cc48b71e-a64c-4a11-847a-162c58b6f0b9. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:16:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8919ae0-949b-4008-bc23-1be6222a9c02 req-44d91af1-d641-482a-b460-10ba255c0363 service nova] Acquiring lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updating instance_info_cache with network_info: [{"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Releasing lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Instance network_info: |[{"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8919ae0-949b-4008-bc23-1be6222a9c02 req-44d91af1-d641-482a-b460-10ba255c0363 service nova] Acquired lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.network.neutron [req-c8919ae0-949b-4008-bc23-1be6222a9c02 req-44d91af1-d641-482a-b460-10ba255c0363 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Refreshing network info cache for port cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Start _get_guest_xml network_info=[{"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:16:51 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:16:51 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1549254796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1549254796',id=1,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-xzw84rld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:16:42Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=a87f39af-29c7-40ee-86c9-ed04a07b9d2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ad:e3,bridge_name='br-int',has_traffic_filtering=True,id=cc48b71e-a64c-4a11-847a-162c58b6f0b9,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc48b71e-a6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'pci_devices' on Instance uuid a87f39af-29c7-40ee-86c9-ed04a07b9d2e {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:16:51 user nova-compute[74892]:   <uuid>a87f39af-29c7-40ee-86c9-ed04a07b9d2e</uuid>
Nov 15 14:16:51 user nova-compute[74892]:   <name>instance-00000001</name>
Nov 15 14:16:51 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:16:51 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:16:51 user nova-compute[74892]:   <metadata>
Nov 15 14:16:51 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:16:51 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:16:51 user nova-compute[74892]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1549254796</nova:name>
Nov 15 14:16:51 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:16:51</nova:creationTime>
Nov 15 14:16:51 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:16:51 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:16:51 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:16:51 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:16:51 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:16:51 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:16:51 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:16:51 user nova-compute[74892]:       <nova:owner>
Nov 15 14:16:51 user nova-compute[74892]:         <nova:user uuid="eccd14bd0c974f4a83aba63fd70df073">tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member</nova:user>
Nov 15 14:16:51 user nova-compute[74892]:         <nova:project uuid="3fcc169292ce42fb9f54aab1db3869bd">tempest-ServerBootFromVolumeStableRescueTest-760148567</nova:project>
Nov 15 14:16:51 user nova-compute[74892]:       </nova:owner>
Nov 15 14:16:51 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:16:51 user nova-compute[74892]:       <nova:ports>
Nov 15 14:16:51 user nova-compute[74892]:         <nova:port uuid="cc48b71e-a64c-4a11-847a-162c58b6f0b9">
Nov 15 14:16:51 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 14:16:51 user nova-compute[74892]:         </nova:port>
Nov 15 14:16:51 user nova-compute[74892]:       </nova:ports>
Nov 15 14:16:51 user nova-compute[74892]:     </nova:instance>
Nov 15 14:16:51 user nova-compute[74892]:   </metadata>
Nov 15 14:16:51 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:16:51 user nova-compute[74892]:     <system>
Nov 15 14:16:51 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:16:51 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:16:51 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:16:51 user nova-compute[74892]:       <entry name="serial">a87f39af-29c7-40ee-86c9-ed04a07b9d2e</entry>
Nov 15 14:16:51 user nova-compute[74892]:       <entry name="uuid">a87f39af-29c7-40ee-86c9-ed04a07b9d2e</entry>
Nov 15 14:16:51 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:16:51 user nova-compute[74892]:     </system>
Nov 15 14:16:51 user nova-compute[74892]:   </sysinfo>
Nov 15 14:16:51 user nova-compute[74892]:   <os>
Nov 15 14:16:51 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:16:51 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:16:51 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:16:51 user nova-compute[74892]:   </os>
Nov 15 14:16:51 user nova-compute[74892]:   <features>
Nov 15 14:16:51 user nova-compute[74892]:     <acpi/>
Nov 15 14:16:51 user nova-compute[74892]:     <apic/>
Nov 15 14:16:51 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:16:51 user nova-compute[74892]:   </features>
Nov 15 14:16:51 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:16:51 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:16:51 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:16:51 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:16:51 user nova-compute[74892]:   </clock>
Nov 15 14:16:51 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:16:51 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:16:51 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:16:51 user nova-compute[74892]:   </cpu>
Nov 15 14:16:51 user nova-compute[74892]:   <devices>
Nov 15 14:16:51 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:16:51 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:16:51 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk"/>
Nov 15 14:16:51 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:16:51 user nova-compute[74892]:     </disk>
Nov 15 14:16:51 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:16:51 user nova-compute[74892]:       <mac address="fa:16:3e:da:ad:e3"/>
Nov 15 14:16:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:16:51 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:16:51 user nova-compute[74892]:       <target dev="tapcc48b71e-a6"/>
Nov 15 14:16:51 user nova-compute[74892]:     </interface>
Nov 15 14:16:51 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:16:51 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/console.log" append="off"/>
Nov 15 14:16:51 user nova-compute[74892]:     </serial>
Nov 15 14:16:51 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:16:51 user nova-compute[74892]:     <video>
Nov 15 14:16:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:16:51 user nova-compute[74892]:     </video>
Nov 15 14:16:51 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:16:51 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:16:51 user nova-compute[74892]:     </rng>
Nov 15 14:16:51 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:16:51 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:16:51 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:16:51 user nova-compute[74892]:     </memballoon>
Nov 15 14:16:51 user nova-compute[74892]:   </devices>
Nov 15 14:16:51 user nova-compute[74892]: </domain>
Nov 15 14:16:51 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1549254796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1549254796',id=1,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-xzw84rld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:16:42Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=a87f39af-29c7-40ee-86c9-ed04a07b9d2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ad:e3,bridge_name='br-int',has_traffic_filtering=True,id=cc48b71e-a64c-4a11-847a-162c58b6f0b9,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc48b71e-a6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG os_vif [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ad:e3,bridge_name='br-int',has_traffic_filtering=True,id=cc48b71e-a64c-4a11-847a-162c58b6f0b9,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc48b71e-a6') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Created schema index Interface.name {{(pid=74892) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Created schema index Port.name {{(pid=74892) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Created schema index Bridge.name {{(pid=74892) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [POLLOUT] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca97dfa5-bb67-5d60-b8e0-ba0eeda1d408', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:16:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:51 user nova-compute[74892]: INFO oslo.privsep.daemon [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpzj2c2e8q/privsep.sock']
Nov 15 14:16:51 user sudo[84202]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpzj2c2e8q/privsep.sock
Nov 15 14:16:51 user sudo[84202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 14:16:52 user nova-compute[74892]: DEBUG nova.network.neutron [req-c8919ae0-949b-4008-bc23-1be6222a9c02 req-44d91af1-d641-482a-b460-10ba255c0363 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updated VIF entry in instance network info cache for port cc48b71e-a64c-4a11-847a-162c58b6f0b9. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:16:52 user nova-compute[74892]: DEBUG nova.network.neutron [req-c8919ae0-949b-4008-bc23-1be6222a9c02 req-44d91af1-d641-482a-b460-10ba255c0363 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updating instance_info_cache with network_info: [{"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:16:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8919ae0-949b-4008-bc23-1be6222a9c02 req-44d91af1-d641-482a-b460-10ba255c0363 service nova] Releasing lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:16:52 user sudo[84202]: pam_unix(sudo:session): session closed for user root
Nov 15 14:16:52 user nova-compute[74892]: INFO oslo.privsep.daemon [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Spawned new privsep daemon via rootwrap
Nov 15 14:16:52 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 14:16:52 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 14:16:52 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 14:16:52 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84211
Nov 15 14:16:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:16:53 user nova-compute[74892]: INFO nova.compute.claims [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Claim successful on node user
Nov 15 14:16:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc48b71e-a6, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc48b71e-a6, col_values=(('qos', UUID('bd4929ab-d470-4d7f-8b31-9d505130ca92')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc48b71e-a6, col_values=(('external_ids', {'iface-id': 'cc48b71e-a64c-4a11-847a-162c58b6f0b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:ad:e3', 'vm-uuid': 'a87f39af-29c7-40ee-86c9-ed04a07b9d2e'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:53 user nova-compute[74892]: INFO os_vif [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ad:e3,bridge_name='br-int',has_traffic_filtering=True,id=cc48b71e-a64c-4a11-847a-162c58b6f0b9,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc48b71e-a6')
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No VIF found with MAC fa:16:3e:da:ad:e3, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:16:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:16:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:16:54 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Creating image(s)
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG nova.policy [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '971828fdd5de481faf9ff0403ecdd3b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fe4fd8971a248c0a7058a1ff448ac92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.163s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk 1073741824" returned: 0 in 0.041s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Cannot resize image /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Ensure instance console log exists: /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:16:55 user nova-compute[74892]: INFO nova.compute.claims [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Claim successful on node user
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:16:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.policy [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe166e9b6134abf85db0e21ec1e100d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe544848b48449381967e24f274b7bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:16:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Creating image(s)
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "/opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "/opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:16:55 user nova-compute[74892]: INFO nova.compute.claims [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Claim successful on node user
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.165s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.232s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk 1073741824" returned: 0 in 0.042s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.608s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.166s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:16:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.policy [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3e99992fb747808166fdd03a2420ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fc70face4045788f0a46bd4cc29867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Cannot resize image /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Ensure instance console log exists: /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Instance spawned successfully.
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:16:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Creating image(s)
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:56 user nova-compute[74892]: INFO nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Took 14.55 seconds to spawn the instance on the hypervisor.
Nov 15 14:16:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:16:57 user nova-compute[74892]: INFO nova.compute.manager [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Took 15.87 seconds to build instance.
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.241s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Successfully created port: c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a4984002-24a3-4e9d-9e4a-ef3e0d077e96 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.164s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.217s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk 1073741824" returned: 0 in 0.048s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.204s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Cannot resize image /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Ensure instance console log exists: /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:57 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Successfully created port: 4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-769dfd95-20ac-4518-ad5e-70cddda75c75 req-eb0b1aa8-9525-4ec6-bf20-16ec34b7be8a service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received event network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-769dfd95-20ac-4518-ad5e-70cddda75c75 req-eb0b1aa8-9525-4ec6-bf20-16ec34b7be8a service nova] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-769dfd95-20ac-4518-ad5e-70cddda75c75 req-eb0b1aa8-9525-4ec6-bf20-16ec34b7be8a service nova] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-769dfd95-20ac-4518-ad5e-70cddda75c75 req-eb0b1aa8-9525-4ec6-bf20-16ec34b7be8a service nova] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-769dfd95-20ac-4518-ad5e-70cddda75c75 req-eb0b1aa8-9525-4ec6-bf20-16ec34b7be8a service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] No waiting events found dispatching network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:16:58 user nova-compute[74892]: WARNING nova.compute.manager [req-769dfd95-20ac-4518-ad5e-70cddda75c75 req-eb0b1aa8-9525-4ec6-bf20-16ec34b7be8a service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received unexpected event network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 for instance with vm_state active and task_state None.
Nov 15 14:16:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Successfully created port: 571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:16:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:16:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Successfully updated port: c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquired lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Successfully updated port: 4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-59c4efdd-6045-4ee1-8805-88a324dc3129 req-48da508a-d5cc-4328-b7da-27b51fe3dc52 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-changed-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-59c4efdd-6045-4ee1-8805-88a324dc3129 req-48da508a-d5cc-4328-b7da-27b51fe3dc52 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Refreshing instance network info cache due to event network-changed-4426f0fd-a229-4b73-a68e-6b9456304d1c. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59c4efdd-6045-4ee1-8805-88a324dc3129 req-48da508a-d5cc-4328-b7da-27b51fe3dc52 service nova] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received event network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] No waiting events found dispatching network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:00 user nova-compute[74892]: WARNING nova.compute.manager [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received unexpected event network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 for instance with vm_state active and task_state None.
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-changed-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Refreshing instance network info cache due to event network-changed-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] Acquiring lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance network_info: |[{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59c4efdd-6045-4ee1-8805-88a324dc3129 req-48da508a-d5cc-4328-b7da-27b51fe3dc52 service nova] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-59c4efdd-6045-4ee1-8805-88a324dc3129 req-48da508a-d5cc-4328-b7da-27b51fe3dc52 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Refreshing network info cache for port 4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Start _get_guest_xml network_info=[{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.objects.instance [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lazy-loading 'pci_devices' on Instance uuid 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:01 user nova-compute[74892]:   <uuid>2cd7a807-53cb-44d6-91cd-3a58b36f2963</uuid>
Nov 15 14:17:01 user nova-compute[74892]:   <name>instance-00000002</name>
Nov 15 14:17:01 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:01 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:01 user nova-compute[74892]:   <metadata>
Nov 15 14:17:01 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:01 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:name>tempest-ServerActionsTestOtherB-server-151320545</nova:name>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:01</nova:creationTime>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:01 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:01 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:user uuid="971828fdd5de481faf9ff0403ecdd3b0">tempest-ServerActionsTestOtherB-1188247760-project-member</nova:user>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:project uuid="7fe4fd8971a248c0a7058a1ff448ac92">tempest-ServerActionsTestOtherB-1188247760</nova:project>
Nov 15 14:17:01 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:port uuid="4426f0fd-a229-4b73-a68e-6b9456304d1c">
Nov 15 14:17:01 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:17:01 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:01 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:01 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:01 user nova-compute[74892]:   </metadata>
Nov 15 14:17:01 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:01 user nova-compute[74892]:     <system>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="serial">2cd7a807-53cb-44d6-91cd-3a58b36f2963</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="uuid">2cd7a807-53cb-44d6-91cd-3a58b36f2963</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:01 user nova-compute[74892]:     </system>
Nov 15 14:17:01 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:01 user nova-compute[74892]:   <os>
Nov 15 14:17:01 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:01 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:01 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:01 user nova-compute[74892]:   </os>
Nov 15 14:17:01 user nova-compute[74892]:   <features>
Nov 15 14:17:01 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:01 user nova-compute[74892]:     <apic/>
Nov 15 14:17:01 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:01 user nova-compute[74892]:   </features>
Nov 15 14:17:01 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:01 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:01 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:01 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:01 user nova-compute[74892]:   </clock>
Nov 15 14:17:01 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:01 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:01 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:01 user nova-compute[74892]:   </cpu>
Nov 15 14:17:01 user nova-compute[74892]:   <devices>
Nov 15 14:17:01 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:01 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:01 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk"/>
Nov 15 14:17:01 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:01 user nova-compute[74892]:     </disk>
Nov 15 14:17:01 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:01 user nova-compute[74892]:       <mac address="fa:16:3e:3d:a8:cd"/>
Nov 15 14:17:01 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:01 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:01 user nova-compute[74892]:       <target dev="tap4426f0fd-a2"/>
Nov 15 14:17:01 user nova-compute[74892]:     </interface>
Nov 15 14:17:01 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:01 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/console.log" append="off"/>
Nov 15 14:17:01 user nova-compute[74892]:     </serial>
Nov 15 14:17:01 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:01 user nova-compute[74892]:     <video>
Nov 15 14:17:01 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:01 user nova-compute[74892]:     </video>
Nov 15 14:17:01 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:01 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:01 user nova-compute[74892]:     </rng>
Nov 15 14:17:01 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:01 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:01 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:01 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:01 user nova-compute[74892]:   </devices>
Nov 15 14:17:01 user nova-compute[74892]: </domain>
Nov 15 14:17:01 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG os_vif [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c41c25ff-c945-50b8-8734-dd44f47af686', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4426f0fd-a2, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4426f0fd-a2, col_values=(('qos', UUID('cafd0cd7-9ab9-4435-9a96-d171333b8681')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4426f0fd-a2, col_values=(('external_ids', {'iface-id': '4426f0fd-a229-4b73-a68e-6b9456304d1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:a8:cd', 'vm-uuid': '2cd7a807-53cb-44d6-91cd-3a58b36f2963'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: INFO os_vif [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2')
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] No VIF found with MAC fa:16:3e:3d:a8:cd, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updating instance_info_cache with network_info: [{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Releasing lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Instance network_info: |[{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] Acquired lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Refreshing network info cache for port c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Start _get_guest_xml network_info=[{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Successfully updated port: 571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323533199',display_name='tempest-ServerActionsTestOtherA-server-1323533199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323533199',id=3,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-nc2vjnh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:16:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=6c7fcea3-5818-4f0d-a0e8-91bef820d398,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ca:7e,bridge_name='br-int',has_traffic_filtering=True,id=c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d9d737-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c7fcea3-5818-4f0d-a0e8-91bef820d398 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquired lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:01 user nova-compute[74892]:   <uuid>6c7fcea3-5818-4f0d-a0e8-91bef820d398</uuid>
Nov 15 14:17:01 user nova-compute[74892]:   <name>instance-00000003</name>
Nov 15 14:17:01 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:01 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:01 user nova-compute[74892]:   <metadata>
Nov 15 14:17:01 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:01 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:name>tempest-ServerActionsTestOtherA-server-1323533199</nova:name>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:01</nova:creationTime>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:01 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:01 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:user uuid="abe166e9b6134abf85db0e21ec1e100d">tempest-ServerActionsTestOtherA-2044893964-project-member</nova:user>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:project uuid="bbe544848b48449381967e24f274b7bd">tempest-ServerActionsTestOtherA-2044893964</nova:project>
Nov 15 14:17:01 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:01 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:01 user nova-compute[74892]:         <nova:port uuid="c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9">
Nov 15 14:17:01 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 14:17:01 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:01 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:01 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:01 user nova-compute[74892]:   </metadata>
Nov 15 14:17:01 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:01 user nova-compute[74892]:     <system>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="serial">6c7fcea3-5818-4f0d-a0e8-91bef820d398</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="uuid">6c7fcea3-5818-4f0d-a0e8-91bef820d398</entry>
Nov 15 14:17:01 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:01 user nova-compute[74892]:     </system>
Nov 15 14:17:01 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:01 user nova-compute[74892]:   <os>
Nov 15 14:17:01 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:01 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:01 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:01 user nova-compute[74892]:   </os>
Nov 15 14:17:01 user nova-compute[74892]:   <features>
Nov 15 14:17:01 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:01 user nova-compute[74892]:     <apic/>
Nov 15 14:17:01 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:01 user nova-compute[74892]:   </features>
Nov 15 14:17:01 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:01 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:01 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:01 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:01 user nova-compute[74892]:   </clock>
Nov 15 14:17:01 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:01 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:01 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:01 user nova-compute[74892]:   </cpu>
Nov 15 14:17:01 user nova-compute[74892]:   <devices>
Nov 15 14:17:01 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:01 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:01 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk"/>
Nov 15 14:17:01 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:01 user nova-compute[74892]:     </disk>
Nov 15 14:17:01 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:01 user nova-compute[74892]:       <mac address="fa:16:3e:b6:ca:7e"/>
Nov 15 14:17:01 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:01 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:01 user nova-compute[74892]:       <target dev="tapc0d9d737-8f"/>
Nov 15 14:17:01 user nova-compute[74892]:     </interface>
Nov 15 14:17:01 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:01 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/console.log" append="off"/>
Nov 15 14:17:01 user nova-compute[74892]:     </serial>
Nov 15 14:17:01 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:01 user nova-compute[74892]:     <video>
Nov 15 14:17:01 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:01 user nova-compute[74892]:     </video>
Nov 15 14:17:01 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:01 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:01 user nova-compute[74892]:     </rng>
Nov 15 14:17:01 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:01 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:01 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:01 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:01 user nova-compute[74892]:   </devices>
Nov 15 14:17:01 user nova-compute[74892]: </domain>
Nov 15 14:17:01 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323533199',display_name='tempest-ServerActionsTestOtherA-server-1323533199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323533199',id=3,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-nc2vjnh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:16:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=6c7fcea3-5818-4f0d-a0e8-91bef820d398,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ca:7e,bridge_name='br-int',has_traffic_filtering=True,id=c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d9d737-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG os_vif [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ca:7e,bridge_name='br-int',has_traffic_filtering=True,id=c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d9d737-8f') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e29618a-9be0-5b31-9a55-f6d5621f4b76', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0d9d737-8f, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0d9d737-8f, col_values=(('qos', UUID('1e10522e-749b-4f48-b480-5515b16eb274')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0d9d737-8f, col_values=(('external_ids', {'iface-id': 'c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:ca:7e', 'vm-uuid': '6c7fcea3-5818-4f0d-a0e8-91bef820d398'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:01 user nova-compute[74892]: INFO os_vif [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:ca:7e,bridge_name='br-int',has_traffic_filtering=True,id=c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d9d737-8f')
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No VIF found with MAC fa:16:3e:b6:ca:7e, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:02 user nova-compute[74892]: DEBUG nova.network.neutron [req-59c4efdd-6045-4ee1-8805-88a324dc3129 req-48da508a-d5cc-4328-b7da-27b51fe3dc52 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updated VIF entry in instance network info cache for port 4426f0fd-a229-4b73-a68e-6b9456304d1c. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:02 user nova-compute[74892]: DEBUG nova.network.neutron [req-59c4efdd-6045-4ee1-8805-88a324dc3129 req-48da508a-d5cc-4328-b7da-27b51fe3dc52 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59c4efdd-6045-4ee1-8805-88a324dc3129 req-48da508a-d5cc-4328-b7da-27b51fe3dc52 service nova] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d7238de-f64b-404f-b9af-ee60b96a718f req-845211e6-c114-42fa-8bc1-7df6ee5bcb8b service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-changed-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d7238de-f64b-404f-b9af-ee60b96a718f req-845211e6-c114-42fa-8bc1-7df6ee5bcb8b service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Refreshing instance network info cache due to event network-changed-571e109b-b616-4b07-84af-97aac4371356. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d7238de-f64b-404f-b9af-ee60b96a718f req-845211e6-c114-42fa-8bc1-7df6ee5bcb8b service nova] Acquiring lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating instance_info_cache with network_info: [{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Releasing lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance network_info: |[{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d7238de-f64b-404f-b9af-ee60b96a718f req-845211e6-c114-42fa-8bc1-7df6ee5bcb8b service nova] Acquired lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-2d7238de-f64b-404f-b9af-ee60b96a718f req-845211e6-c114-42fa-8bc1-7df6ee5bcb8b service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Refreshing network info cache for port 571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Start _get_guest_xml network_info=[{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updated VIF entry in instance network info cache for port c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updating instance_info_cache with network_info: [{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:03 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:03 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1702806374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1702806374',id=4,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcKO71oeZrgy6wz9s/wPxza901ZFMNKyl2MUdIi82+6RHq4oQxD7hsBGsnSKky8SJzUR8AZKzc+Nx4KVU1pFWiG2B+khnBeJ7VgrHzCGzypwZl4fbObFWScYtHqED6u+w==',key_name='tempest-keypair-1680936907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ryzg4t4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:16:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=ffa60aac-02a4-42ab-b97b-b9cc56079e44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.objects.instance [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'pci_devices' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cdfe8945-f8aa-4d80-b672-885f9af47198 req-86d3c57a-82dc-4ee9-a6b8-3d857f59b38e service nova] Releasing lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:03 user nova-compute[74892]:   <uuid>ffa60aac-02a4-42ab-b97b-b9cc56079e44</uuid>
Nov 15 14:17:03 user nova-compute[74892]:   <name>instance-00000004</name>
Nov 15 14:17:03 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:03 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:03 user nova-compute[74892]:   <metadata>
Nov 15 14:17:03 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:03 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:03 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1702806374</nova:name>
Nov 15 14:17:03 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:03</nova:creationTime>
Nov 15 14:17:03 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:03 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:03 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:03 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:03 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:03 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:03 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:03 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:03 user nova-compute[74892]:         <nova:user uuid="0c3e99992fb747808166fdd03a2420ff">tempest-AttachVolumeShelveTestJSON-769417742-project-member</nova:user>
Nov 15 14:17:03 user nova-compute[74892]:         <nova:project uuid="05fc70face4045788f0a46bd4cc29867">tempest-AttachVolumeShelveTestJSON-769417742</nova:project>
Nov 15 14:17:03 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:03 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:03 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:03 user nova-compute[74892]:         <nova:port uuid="571e109b-b616-4b07-84af-97aac4371356">
Nov 15 14:17:03 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 14:17:03 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:03 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:03 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:03 user nova-compute[74892]:   </metadata>
Nov 15 14:17:03 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:03 user nova-compute[74892]:     <system>
Nov 15 14:17:03 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:03 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:03 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:03 user nova-compute[74892]:       <entry name="serial">ffa60aac-02a4-42ab-b97b-b9cc56079e44</entry>
Nov 15 14:17:03 user nova-compute[74892]:       <entry name="uuid">ffa60aac-02a4-42ab-b97b-b9cc56079e44</entry>
Nov 15 14:17:03 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:03 user nova-compute[74892]:     </system>
Nov 15 14:17:03 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:03 user nova-compute[74892]:   <os>
Nov 15 14:17:03 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:03 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:03 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:03 user nova-compute[74892]:   </os>
Nov 15 14:17:03 user nova-compute[74892]:   <features>
Nov 15 14:17:03 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:03 user nova-compute[74892]:     <apic/>
Nov 15 14:17:03 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:03 user nova-compute[74892]:   </features>
Nov 15 14:17:03 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:03 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:03 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:03 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:03 user nova-compute[74892]:   </clock>
Nov 15 14:17:03 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:03 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:03 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:03 user nova-compute[74892]:   </cpu>
Nov 15 14:17:03 user nova-compute[74892]:   <devices>
Nov 15 14:17:03 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:03 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:03 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk"/>
Nov 15 14:17:03 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:03 user nova-compute[74892]:     </disk>
Nov 15 14:17:03 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:03 user nova-compute[74892]:       <mac address="fa:16:3e:2e:95:f5"/>
Nov 15 14:17:03 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:03 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:03 user nova-compute[74892]:       <target dev="tap571e109b-b6"/>
Nov 15 14:17:03 user nova-compute[74892]:     </interface>
Nov 15 14:17:03 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:03 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/console.log" append="off"/>
Nov 15 14:17:03 user nova-compute[74892]:     </serial>
Nov 15 14:17:03 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:03 user nova-compute[74892]:     <video>
Nov 15 14:17:03 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:03 user nova-compute[74892]:     </video>
Nov 15 14:17:03 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:03 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:03 user nova-compute[74892]:     </rng>
Nov 15 14:17:03 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:03 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:03 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:03 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:03 user nova-compute[74892]:   </devices>
Nov 15 14:17:03 user nova-compute[74892]: </domain>
Nov 15 14:17:03 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1702806374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1702806374',id=4,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcKO71oeZrgy6wz9s/wPxza901ZFMNKyl2MUdIi82+6RHq4oQxD7hsBGsnSKky8SJzUR8AZKzc+Nx4KVU1pFWiG2B+khnBeJ7VgrHzCGzypwZl4fbObFWScYtHqED6u+w==',key_name='tempest-keypair-1680936907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ryzg4t4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:16:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=ffa60aac-02a4-42ab-b97b-b9cc56079e44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG os_vif [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4b05c12-cc08-55a6-90a4-fcca7cb05910', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap571e109b-b6, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap571e109b-b6, col_values=(('qos', UUID('169d584b-319f-43e5-8da8-44c1adf5f117')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap571e109b-b6, col_values=(('external_ids', {'iface-id': '571e109b-b616-4b07-84af-97aac4371356', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:95:f5', 'vm-uuid': 'ffa60aac-02a4-42ab-b97b-b9cc56079e44'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:03 user nova-compute[74892]: INFO os_vif [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6')
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No VIF found with MAC fa:16:3e:2e:95:f5, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-2d7238de-f64b-404f-b9af-ee60b96a718f req-845211e6-c114-42fa-8bc1-7df6ee5bcb8b service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updated VIF entry in instance network info cache for port 571e109b-b616-4b07-84af-97aac4371356. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-2d7238de-f64b-404f-b9af-ee60b96a718f req-845211e6-c114-42fa-8bc1-7df6ee5bcb8b service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating instance_info_cache with network_info: [{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d7238de-f64b-404f-b9af-ee60b96a718f req-845211e6-c114-42fa-8bc1-7df6ee5bcb8b service nova] Releasing lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:17:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:07 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:17:07 user nova-compute[74892]: INFO nova.compute.claims [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Claim successful on node user
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:17:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:17:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.policy [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5945249c9efe4a40980557b4aba1d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed8813ce754c82b8abaa69a5e509f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:17:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Creating image(s)
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "/opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "/opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "/opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:17:08 user nova-compute[74892]: INFO nova.compute.claims [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Claim successful on node user
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.292s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.302s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:09 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance spawned successfully.
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk 1073741824" returned: 0 in 0.092s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.399s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:09 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Instance spawned successfully.
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.800s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:17:09 user nova-compute[74892]: INFO nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Took 15.40 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Successfully created port: 188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:09 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance spawned successfully.
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.network.neutron [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:17:09 user nova-compute[74892]: INFO nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Took 13.90 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:09 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.359s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:09 user nova-compute[74892]: INFO nova.compute.manager [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Took 16.34 seconds to build instance.
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cb4aa42-43d9-4c12-a27a-c0a7b5e04960 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.473s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.policy [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff8da0e6ced646b48cf2e8f256421f48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73cb52a070f04d9a88bfbd2d0e1630ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.009s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Cannot resize image /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Ensure instance console log exists: /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:10 user nova-compute[74892]: INFO nova.compute.manager [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Took 15.05 seconds to build instance.
Nov 15 14:17:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:17:10 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Creating image(s)
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "/opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "/opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "e03890e3-60d4-4719-a2db-7cc1fe245b11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3a6ff2dc-8794-42b5-8fbb-e6840b9abe11 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.502s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:10 user nova-compute[74892]: INFO nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Took 13.44 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:17:10 user nova-compute[74892]: INFO nova.compute.claims [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Claim successful on node user
Nov 15 14:17:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.276s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.008s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:10 user nova-compute[74892]: INFO nova.compute.manager [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Took 14.91 seconds to build instance.
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9aed2c50-45a5-4743-a39a-42b3a081bcec tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.049s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.252s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk 1073741824" returned: 0 in 0.134s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.391s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.256s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.110s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.624s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:17:11 user nova-compute[74892]: INFO nova.compute.claims [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Claim successful on node user
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Cannot resize image /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Ensure instance console log exists: /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:17:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Successfully updated port: 188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquired lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.policy [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '096ca6cfce6b437f85f220646f97b902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446202d935a749749fbba99be6a1d00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-e914cda8-9a25-4457-bed7-03f5a71716fa req-0ec2e4f1-9a46-4573-8fd7-bf89d99f7808 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received event network-changed-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-e914cda8-9a25-4457-bed7-03f5a71716fa req-0ec2e4f1-9a46-4573-8fd7-bf89d99f7808 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Refreshing instance network info cache due to event network-changed-188d856a-8fff-4e87-ada8-31361f90d65f. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e914cda8-9a25-4457-bed7-03f5a71716fa req-0ec2e4f1-9a46-4573-8fd7-bf89d99f7808 service nova] Acquiring lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:17:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Creating image(s)
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Successfully created port: 5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.233s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.953s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.261s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.549s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updating instance_info_cache with network_info: [{"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:17:12 user nova-compute[74892]: INFO nova.compute.claims [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Claim successful on node user
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk 1073741824" returned: 0 in 0.070s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.336s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Releasing lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Instance network_info: |[{"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e914cda8-9a25-4457-bed7-03f5a71716fa req-0ec2e4f1-9a46-4573-8fd7-bf89d99f7808 service nova] Acquired lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.network.neutron [req-e914cda8-9a25-4457-bed7-03f5a71716fa req-0ec2e4f1-9a46-4573-8fd7-bf89d99f7808 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Refreshing network info cache for port 188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Start _get_guest_xml network_info=[{"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:17:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1830236721',display_name='tempest-VolumesAdminNegativeTest-server-1830236721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1830236721',id=5,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmWmUu0SdyDj6U6V/VNcADVuloXAU7YNTuzTyukZMm6ffdwMmLz/GHqeTtndIMOOMU8/5wJBU+FuUyBUeSBtQyDSrc274iMvGOp95aA4/X60SJOwBEPvIBGSHfXfsTTWw==',key_name='tempest-keypair-881156275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ed8813ce754c82b8abaa69a5e509f1',ramdisk_id='',reservation_id='r-1x8vwaly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1173866799',owner_user_name='tempest-VolumesAdminNegativeTest-1173866799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5945249c9efe4a40980557b4aba1d0da',uuid=a038db7d-023b-44ac-a74e-be018b0b6492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converting VIF {"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=188d856a-8fff-4e87-ada8-31361f90d65f,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d856a-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lazy-loading 'pci_devices' on Instance uuid a038db7d-023b-44ac-a74e-be018b0b6492 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.policy [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99f4ed77744d4cdb80cca826b6dc50b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24aea1db854c42c0aa85018c5518b0a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.286s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:12 user nova-compute[74892]:   <uuid>a038db7d-023b-44ac-a74e-be018b0b6492</uuid>
Nov 15 14:17:12 user nova-compute[74892]:   <name>instance-00000005</name>
Nov 15 14:17:12 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:12 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:12 user nova-compute[74892]:   <metadata>
Nov 15 14:17:12 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:12 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:12 user nova-compute[74892]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1830236721</nova:name>
Nov 15 14:17:12 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:12</nova:creationTime>
Nov 15 14:17:12 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:12 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:12 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:12 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:12 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:12 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:12 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:12 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:12 user nova-compute[74892]:         <nova:user uuid="5945249c9efe4a40980557b4aba1d0da">tempest-VolumesAdminNegativeTest-1173866799-project-member</nova:user>
Nov 15 14:17:12 user nova-compute[74892]:         <nova:project uuid="d2ed8813ce754c82b8abaa69a5e509f1">tempest-VolumesAdminNegativeTest-1173866799</nova:project>
Nov 15 14:17:12 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:12 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:12 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:12 user nova-compute[74892]:         <nova:port uuid="188d856a-8fff-4e87-ada8-31361f90d65f">
Nov 15 14:17:12 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:17:12 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:12 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:12 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:12 user nova-compute[74892]:   </metadata>
Nov 15 14:17:12 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:12 user nova-compute[74892]:     <system>
Nov 15 14:17:12 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:12 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:12 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:12 user nova-compute[74892]:       <entry name="serial">a038db7d-023b-44ac-a74e-be018b0b6492</entry>
Nov 15 14:17:12 user nova-compute[74892]:       <entry name="uuid">a038db7d-023b-44ac-a74e-be018b0b6492</entry>
Nov 15 14:17:12 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:12 user nova-compute[74892]:     </system>
Nov 15 14:17:12 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:12 user nova-compute[74892]:   <os>
Nov 15 14:17:12 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:12 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:12 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:12 user nova-compute[74892]:   </os>
Nov 15 14:17:12 user nova-compute[74892]:   <features>
Nov 15 14:17:12 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:12 user nova-compute[74892]:     <apic/>
Nov 15 14:17:12 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:12 user nova-compute[74892]:   </features>
Nov 15 14:17:12 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:12 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:12 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:12 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:12 user nova-compute[74892]:   </clock>
Nov 15 14:17:12 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:12 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:12 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:12 user nova-compute[74892]:   </cpu>
Nov 15 14:17:12 user nova-compute[74892]:   <devices>
Nov 15 14:17:12 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:12 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:12 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk"/>
Nov 15 14:17:12 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:12 user nova-compute[74892]:     </disk>
Nov 15 14:17:12 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:12 user nova-compute[74892]:       <mac address="fa:16:3e:e8:6d:79"/>
Nov 15 14:17:12 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:12 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:12 user nova-compute[74892]:       <target dev="tap188d856a-8f"/>
Nov 15 14:17:12 user nova-compute[74892]:     </interface>
Nov 15 14:17:12 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:12 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/console.log" append="off"/>
Nov 15 14:17:12 user nova-compute[74892]:     </serial>
Nov 15 14:17:12 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:12 user nova-compute[74892]:     <video>
Nov 15 14:17:12 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:12 user nova-compute[74892]:     </video>
Nov 15 14:17:12 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:12 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:12 user nova-compute[74892]:     </rng>
Nov 15 14:17:12 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:12 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:12 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:12 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:12 user nova-compute[74892]:   </devices>
Nov 15 14:17:12 user nova-compute[74892]: </domain>
Nov 15 14:17:12 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1830236721',display_name='tempest-VolumesAdminNegativeTest-server-1830236721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1830236721',id=5,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmWmUu0SdyDj6U6V/VNcADVuloXAU7YNTuzTyukZMm6ffdwMmLz/GHqeTtndIMOOMU8/5wJBU+FuUyBUeSBtQyDSrc274iMvGOp95aA4/X60SJOwBEPvIBGSHfXfsTTWw==',key_name='tempest-keypair-881156275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ed8813ce754c82b8abaa69a5e509f1',ramdisk_id='',reservation_id='r-1x8vwaly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1173866799',owner_user_name='tempest-VolumesAdminNegativeTest-1173866799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5945249c9efe4a40980557b4aba1d0da',uuid=a038db7d-023b-44ac-a74e-be018b0b6492,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converting VIF {"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=188d856a-8fff-4e87-ada8-31361f90d65f,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d856a-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG os_vif [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=188d856a-8fff-4e87-ada8-31361f90d65f,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d856a-8f') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3050541-7787-5bad-9849-c6969a275242', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:17:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Creating image(s)
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "/opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "/opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "/opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap188d856a-8f, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap188d856a-8f, col_values=(('qos', UUID('956058a9-e2a8-4a1e-874f-51a58e72dafc')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap188d856a-8f, col_values=(('external_ids', {'iface-id': '188d856a-8fff-4e87-ada8-31361f90d65f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:6d:79', 'vm-uuid': 'a038db7d-023b-44ac-a74e-be018b0b6492'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:12 user nova-compute[74892]: INFO os_vif [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=188d856a-8fff-4e87-ada8-31361f90d65f,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d856a-8f')
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Cannot resize image /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Ensure instance console log exists: /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] No VIF found with MAC fa:16:3e:e8:6d:79, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.network.neutron [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Successfully updated port: 5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquired lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.network.neutron [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.908s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.310s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:13 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.network.neutron [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk 1073741824" returned: 0 in 0.120s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.449s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:13 user nova-compute[74892]: INFO nova.virt.block_device [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Booting with volume f2ba5dc0-2823-48ed-98ff-bc471a20f00a at /dev/vda
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Successfully created port: 4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.256s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG os_brick.utils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:17:13 user nova-compute[74892]: INFO oslo.privsep.daemon [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp2q93l2co/privsep.sock']
Nov 15 14:17:13 user sudo[84890]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp2q93l2co/privsep.sock
Nov 15 14:17:13 user sudo[84890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-e914cda8-9a25-4457-bed7-03f5a71716fa req-0ec2e4f1-9a46-4573-8fd7-bf89d99f7808 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updated VIF entry in instance network info cache for port 188d856a-8fff-4e87-ada8-31361f90d65f. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-e914cda8-9a25-4457-bed7-03f5a71716fa req-0ec2e4f1-9a46-4573-8fd7-bf89d99f7808 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updating instance_info_cache with network_info: [{"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Cannot resize image /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Ensure instance console log exists: /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e914cda8-9a25-4457-bed7-03f5a71716fa req-0ec2e4f1-9a46-4573-8fd7-bf89d99f7808 service nova] Releasing lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-0372053a-93e2-48ef-af23-cf750a0938e3 req-e90fbed2-3481-429a-9df0-7b4079d5804f service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received event network-changed-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-0372053a-93e2-48ef-af23-cf750a0938e3 req-e90fbed2-3481-429a-9df0-7b4079d5804f service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Refreshing instance network info cache due to event network-changed-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0372053a-93e2-48ef-af23-cf750a0938e3 req-e90fbed2-3481-429a-9df0-7b4079d5804f service nova] Acquiring lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:13 user nova-compute[74892]: DEBUG nova.policy [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92f2936bf65e4ca3be5b6f81718d8a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92bc8d0616234fdf92d29834bda6d906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.network.neutron [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Successfully created port: 591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.network.neutron [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Updating instance_info_cache with network_info: [{"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Releasing lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Instance network_info: |[{"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0372053a-93e2-48ef-af23-cf750a0938e3 req-e90fbed2-3481-429a-9df0-7b4079d5804f service nova] Acquired lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.network.neutron [req-0372053a-93e2-48ef-af23-cf750a0938e3 req-e90fbed2-3481-429a-9df0-7b4079d5804f service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Refreshing network info cache for port 5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Start _get_guest_xml network_info=[{"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:14 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:14 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-934445170',display_name='tempest-TestVolumeSwap-server-934445170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-934445170',id=6,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvoHmttPuvpE3HSVYXIIGpDKqPel41NZ1P8FRt4EarRAjoAQ9HlHFCf5IQ5Rup2xQJQVtxxvHGXhyVnfIuu7QOfV3SMcd9RaxYKKUnBXftxKSmp7VvfFLqe3VNZWgUnIg==',key_name='tempest-keypair-1799138538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73cb52a070f04d9a88bfbd2d0e1630ac',ramdisk_id='',reservation_id='r-swegoyy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-157134899',owner_user_name='tempest-TestVolumeSwap-157134899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff8da0e6ced646b48cf2e8f256421f48',uuid=8ff18e3b-6d7e-40b2-af8e-958c185cd7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Converting VIF {"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75,network=Network(796b9f2a-c688-42d4-9563-260bd45d0bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496be4c-9a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.objects.instance [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:14 user nova-compute[74892]:   <uuid>8ff18e3b-6d7e-40b2-af8e-958c185cd7dd</uuid>
Nov 15 14:17:14 user nova-compute[74892]:   <name>instance-00000006</name>
Nov 15 14:17:14 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:14 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:14 user nova-compute[74892]:   <metadata>
Nov 15 14:17:14 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:14 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:14 user nova-compute[74892]:       <nova:name>tempest-TestVolumeSwap-server-934445170</nova:name>
Nov 15 14:17:14 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:14</nova:creationTime>
Nov 15 14:17:14 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:14 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:14 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:14 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:14 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:14 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:14 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:14 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:14 user nova-compute[74892]:         <nova:user uuid="ff8da0e6ced646b48cf2e8f256421f48">tempest-TestVolumeSwap-157134899-project-member</nova:user>
Nov 15 14:17:14 user nova-compute[74892]:         <nova:project uuid="73cb52a070f04d9a88bfbd2d0e1630ac">tempest-TestVolumeSwap-157134899</nova:project>
Nov 15 14:17:14 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:14 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:14 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:14 user nova-compute[74892]:         <nova:port uuid="5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75">
Nov 15 14:17:14 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:17:14 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:14 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:14 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:14 user nova-compute[74892]:   </metadata>
Nov 15 14:17:14 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:14 user nova-compute[74892]:     <system>
Nov 15 14:17:14 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:14 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:14 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:14 user nova-compute[74892]:       <entry name="serial">8ff18e3b-6d7e-40b2-af8e-958c185cd7dd</entry>
Nov 15 14:17:14 user nova-compute[74892]:       <entry name="uuid">8ff18e3b-6d7e-40b2-af8e-958c185cd7dd</entry>
Nov 15 14:17:14 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:14 user nova-compute[74892]:     </system>
Nov 15 14:17:14 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:14 user nova-compute[74892]:   <os>
Nov 15 14:17:14 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:14 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:14 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:14 user nova-compute[74892]:   </os>
Nov 15 14:17:14 user nova-compute[74892]:   <features>
Nov 15 14:17:14 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:14 user nova-compute[74892]:     <apic/>
Nov 15 14:17:14 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:14 user nova-compute[74892]:   </features>
Nov 15 14:17:14 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:14 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:14 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:14 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:14 user nova-compute[74892]:   </clock>
Nov 15 14:17:14 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:14 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:14 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:14 user nova-compute[74892]:   </cpu>
Nov 15 14:17:14 user nova-compute[74892]:   <devices>
Nov 15 14:17:14 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:14 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:14 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk"/>
Nov 15 14:17:14 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:14 user nova-compute[74892]:     </disk>
Nov 15 14:17:14 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:14 user nova-compute[74892]:       <mac address="fa:16:3e:ff:aa:d8"/>
Nov 15 14:17:14 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:14 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:14 user nova-compute[74892]:       <target dev="tap5496be4c-9a"/>
Nov 15 14:17:14 user nova-compute[74892]:     </interface>
Nov 15 14:17:14 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:14 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/console.log" append="off"/>
Nov 15 14:17:14 user nova-compute[74892]:     </serial>
Nov 15 14:17:14 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:14 user nova-compute[74892]:     <video>
Nov 15 14:17:14 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:14 user nova-compute[74892]:     </video>
Nov 15 14:17:14 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:14 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:14 user nova-compute[74892]:     </rng>
Nov 15 14:17:14 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:14 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:14 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:14 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:14 user nova-compute[74892]:   </devices>
Nov 15 14:17:14 user nova-compute[74892]: </domain>
Nov 15 14:17:14 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-934445170',display_name='tempest-TestVolumeSwap-server-934445170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-934445170',id=6,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvoHmttPuvpE3HSVYXIIGpDKqPel41NZ1P8FRt4EarRAjoAQ9HlHFCf5IQ5Rup2xQJQVtxxvHGXhyVnfIuu7QOfV3SMcd9RaxYKKUnBXftxKSmp7VvfFLqe3VNZWgUnIg==',key_name='tempest-keypair-1799138538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73cb52a070f04d9a88bfbd2d0e1630ac',ramdisk_id='',reservation_id='r-swegoyy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-157134899',owner_user_name='tempest-TestVolumeSwap-157134899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff8da0e6ced646b48cf2e8f256421f48',uuid=8ff18e3b-6d7e-40b2-af8e-958c185cd7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Converting VIF {"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75,network=Network(796b9f2a-c688-42d4-9563-260bd45d0bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496be4c-9a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG os_vif [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75,network=Network(796b9f2a-c688-42d4-9563-260bd45d0bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496be4c-9a') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b06fd634-f700-59b4-be72-c42de11b09aa', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5496be4c-9a, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5496be4c-9a, col_values=(('qos', UUID('c8e17e7a-4e30-438e-beac-3559d44746bb')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5496be4c-9a, col_values=(('external_ids', {'iface-id': '5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:aa:d8', 'vm-uuid': '8ff18e3b-6d7e-40b2-af8e-958c185cd7dd'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: INFO os_vif [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75,network=Network(796b9f2a-c688-42d4-9563-260bd45d0bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496be4c-9a')
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] No VIF found with MAC fa:16:3e:ff:aa:d8, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Successfully updated port: 4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquired lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [req-0372053a-93e2-48ef-af23-cf750a0938e3 req-e90fbed2-3481-429a-9df0-7b4079d5804f service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Updated VIF entry in instance network info cache for port 5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [req-0372053a-93e2-48ef-af23-cf750a0938e3 req-e90fbed2-3481-429a-9df0-7b4079d5804f service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Updating instance_info_cache with network_info: [{"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-2dadd98d-8d6a-4c3e-9f06-52843a33474b req-1fe76a4c-8368-43da-b002-92a1d71b8bf1 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-changed-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-2dadd98d-8d6a-4c3e-9f06-52843a33474b req-1fe76a4c-8368-43da-b002-92a1d71b8bf1 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Refreshing instance network info cache due to event network-changed-4c90eb33-2bf7-404b-a08e-c268206cdd69. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2dadd98d-8d6a-4c3e-9f06-52843a33474b req-1fe76a4c-8368-43da-b002-92a1d71b8bf1 service nova] Acquiring lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0372053a-93e2-48ef-af23-cf750a0938e3 req-e90fbed2-3481-429a-9df0-7b4079d5804f service nova] Releasing lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Successfully updated port: 591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "refresh_cache-e03890e3-60d4-4719-a2db-7cc1fe245b11" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquired lock "refresh_cache-e03890e3-60d4-4719-a2db-7cc1fe245b11" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:15 user sudo[84890]: pam_unix(sudo:session): session closed for user root
Nov 15 14:17:15 user nova-compute[74892]: INFO oslo.privsep.daemon [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Spawned new privsep daemon via rootwrap
Nov 15 14:17:15 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 14:17:15 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 14:17:15 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 14:17:15 user nova-compute[74892]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85038
Nov 15 14:17:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cf1806-b0a5-4913-bd1e-464c72bb035c]: (2,) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-f667d2be-a1e9-4808-a20f-7aa83c1192bd req-82fdcb7b-2093-41a8-b0c2-c289411d4c84 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received event network-changed-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-f667d2be-a1e9-4808-a20f-7aa83c1192bd req-82fdcb7b-2093-41a8-b0c2-c289411d4c84 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Refreshing instance network info cache due to event network-changed-591e68d4-53a5-411c-b419-55b0b833abc5. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f667d2be-a1e9-4808-a20f-7aa83c1192bd req-82fdcb7b-2093-41a8-b0c2-c289411d4c84 service nova] Acquiring lock "refresh_cache-e03890e3-60d4-4719-a2db-7cc1fe245b11" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Releasing lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Instance network_info: |[{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2dadd98d-8d6a-4c3e-9f06-52843a33474b req-1fe76a4c-8368-43da-b002-92a1d71b8bf1 service nova] Acquired lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.neutron [req-2dadd98d-8d6a-4c3e-9f06-52843a33474b req-1fe76a4c-8368-43da-b002-92a1d71b8bf1 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Refreshing network info cache for port 4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Start _get_guest_xml network_info=[{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converting VIF {"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:03:b4,bridge_name='br-int',has_traffic_filtering=True,id=4c90eb33-2bf7-404b-a08e-c268206cdd69,network=Network(ad3f36db-6d74-4016-bca0-b9d8394c182e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90eb33-2b') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lazy-loading 'pci_devices' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:16 user nova-compute[74892]:   <uuid>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</uuid>
Nov 15 14:17:16 user nova-compute[74892]:   <name>instance-00000007</name>
Nov 15 14:17:16 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:16 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:16 user nova-compute[74892]:   <metadata>
Nov 15 14:17:16 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:16 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:name>tempest-device-tagging-server-1329550711</nova:name>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:16</nova:creationTime>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:16 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:16 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:user uuid="096ca6cfce6b437f85f220646f97b902">tempest-TaggedAttachmentsTest-785094056-project-member</nova:user>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:project uuid="446202d935a749749fbba99be6a1d00c">tempest-TaggedAttachmentsTest-785094056</nova:project>
Nov 15 14:17:16 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:port uuid="4c90eb33-2bf7-404b-a08e-c268206cdd69">
Nov 15 14:17:16 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:17:16 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:16 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:16 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:16 user nova-compute[74892]:   </metadata>
Nov 15 14:17:16 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:16 user nova-compute[74892]:     <system>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="serial">16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="uuid">16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:16 user nova-compute[74892]:     </system>
Nov 15 14:17:16 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:16 user nova-compute[74892]:   <os>
Nov 15 14:17:16 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:16 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:16 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:16 user nova-compute[74892]:   </os>
Nov 15 14:17:16 user nova-compute[74892]:   <features>
Nov 15 14:17:16 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:16 user nova-compute[74892]:     <apic/>
Nov 15 14:17:16 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:16 user nova-compute[74892]:   </features>
Nov 15 14:17:16 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:16 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:16 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:16 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:16 user nova-compute[74892]:   </clock>
Nov 15 14:17:16 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:16 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:16 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:16 user nova-compute[74892]:   </cpu>
Nov 15 14:17:16 user nova-compute[74892]:   <devices>
Nov 15 14:17:16 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:16 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:16 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk"/>
Nov 15 14:17:16 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:16 user nova-compute[74892]:     </disk>
Nov 15 14:17:16 user nova-compute[74892]:     <disk type="file" device="cdrom">
Nov 15 14:17:16 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 14:17:16 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.config"/>
Nov 15 14:17:16 user nova-compute[74892]:       <target dev="hda" bus="ide"/>
Nov 15 14:17:16 user nova-compute[74892]:     </disk>
Nov 15 14:17:16 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:16 user nova-compute[74892]:       <mac address="fa:16:3e:ba:03:b4"/>
Nov 15 14:17:16 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:16 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:16 user nova-compute[74892]:       <target dev="tap4c90eb33-2b"/>
Nov 15 14:17:16 user nova-compute[74892]:     </interface>
Nov 15 14:17:16 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:16 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log" append="off"/>
Nov 15 14:17:16 user nova-compute[74892]:     </serial>
Nov 15 14:17:16 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:16 user nova-compute[74892]:     <video>
Nov 15 14:17:16 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:16 user nova-compute[74892]:     </video>
Nov 15 14:17:16 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:16 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:16 user nova-compute[74892]:     </rng>
Nov 15 14:17:16 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:16 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:16 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:16 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:16 user nova-compute[74892]:   </devices>
Nov 15 14:17:16 user nova-compute[74892]: </domain>
Nov 15 14:17:16 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converting VIF {"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:03:b4,bridge_name='br-int',has_traffic_filtering=True,id=4c90eb33-2bf7-404b-a08e-c268206cdd69,network=Network(ad3f36db-6d74-4016-bca0-b9d8394c182e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90eb33-2b') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG os_vif [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:03:b4,bridge_name='br-int',has_traffic_filtering=True,id=4c90eb33-2bf7-404b-a08e-c268206cdd69,network=Network(ad3f36db-6d74-4016-bca0-b9d8394c182e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90eb33-2b') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Successfully created port: 1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f85ecaed-a01c-5e4e-bbb2-73e45216a80a', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c90eb33-2b, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c90eb33-2b, col_values=(('qos', UUID('72af2f58-2cb8-4fff-a6e6-3c49cd042572')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c90eb33-2b, col_values=(('external_ids', {'iface-id': '4c90eb33-2bf7-404b-a08e-c268206cdd69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:03:b4', 'vm-uuid': '16c1e6b8-fe5d-4a42-b8cb-453b37c88b46'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f21a381-81cf-4320-950a-b04fa22218c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:16 user nova-compute[74892]: WARNING os_brick.initiator.connectors.nvmeof [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: INFO os_vif [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:03:b4,bridge_name='br-int',has_traffic_filtering=True,id=4c90eb33-2bf7-404b-a08e-c268206cdd69,network=Network(ad3f36db-6d74-4016-bca0-b9d8394c182e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90eb33-2b')
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf03782-51cb-42ba-bf76-1d8520c6b088]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef2fb07-74f7-407f-a4dc-8902cd49d1be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa99bae-6b19-489a-9115-52f697faaa33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Updating instance_info_cache with network_info: [{"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Releasing lock "refresh_cache-e03890e3-60d4-4719-a2db-7cc1fe245b11" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Instance network_info: |[{"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f667d2be-a1e9-4808-a20f-7aa83c1192bd req-82fdcb7b-2093-41a8-b0c2-c289411d4c84 service nova] Acquired lock "refresh_cache-e03890e3-60d4-4719-a2db-7cc1fe245b11" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.neutron [req-f667d2be-a1e9-4808-a20f-7aa83c1192bd req-82fdcb7b-2093-41a8-b0c2-c289411d4c84 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Refreshing network info cache for port 591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Start _get_guest_xml network_info=[{"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No BDM found with device name hda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No VIF found with MAC fa:16:3e:ba:03:b4, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:16 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Using config drive
Nov 15 14:17:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:17:16 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:17:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e136a44b-3aee-4d4f-af85-bf66623dee7f]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG os_brick.utils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] <== get_connector_properties: return (2748ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Updating existing volume attachment record: 84710ffb-4b6b-4bf5-a403-3c917d7e8406 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1328408325',display_name='tempest-VolumesActionsTest-instance-1328408325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1328408325',id=8,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24aea1db854c42c0aa85018c5518b0a5',ramdisk_id='',reservation_id='r-0zsim08u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1307238287',owner_user_name='tempest-VolumesActionsTest-1307238287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:12Z,user_data=None,user_id='99f4ed77744d4cdb80cca826b6dc50b9',uuid=e03890e3-60d4-4719-a2db-7cc1fe245b11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converting VIF {"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:fa:ba,bridge_name='br-int',has_traffic_filtering=True,id=591e68d4-53a5-411c-b419-55b0b833abc5,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591e68d4-53') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.objects.instance [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lazy-loading 'pci_devices' on Instance uuid e03890e3-60d4-4719-a2db-7cc1fe245b11 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:16 user nova-compute[74892]:   <uuid>e03890e3-60d4-4719-a2db-7cc1fe245b11</uuid>
Nov 15 14:17:16 user nova-compute[74892]:   <name>instance-00000008</name>
Nov 15 14:17:16 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:16 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:16 user nova-compute[74892]:   <metadata>
Nov 15 14:17:16 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:16 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:name>tempest-VolumesActionsTest-instance-1328408325</nova:name>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:16</nova:creationTime>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:16 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:16 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:user uuid="99f4ed77744d4cdb80cca826b6dc50b9">tempest-VolumesActionsTest-1307238287-project-member</nova:user>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:project uuid="24aea1db854c42c0aa85018c5518b0a5">tempest-VolumesActionsTest-1307238287</nova:project>
Nov 15 14:17:16 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:16 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:16 user nova-compute[74892]:         <nova:port uuid="591e68d4-53a5-411c-b419-55b0b833abc5">
Nov 15 14:17:16 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:17:16 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:16 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:16 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:16 user nova-compute[74892]:   </metadata>
Nov 15 14:17:16 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:16 user nova-compute[74892]:     <system>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="serial">e03890e3-60d4-4719-a2db-7cc1fe245b11</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="uuid">e03890e3-60d4-4719-a2db-7cc1fe245b11</entry>
Nov 15 14:17:16 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:16 user nova-compute[74892]:     </system>
Nov 15 14:17:16 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:16 user nova-compute[74892]:   <os>
Nov 15 14:17:16 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:16 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:16 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:16 user nova-compute[74892]:   </os>
Nov 15 14:17:16 user nova-compute[74892]:   <features>
Nov 15 14:17:16 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:16 user nova-compute[74892]:     <apic/>
Nov 15 14:17:16 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:16 user nova-compute[74892]:   </features>
Nov 15 14:17:16 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:16 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:16 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:16 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:16 user nova-compute[74892]:   </clock>
Nov 15 14:17:16 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:16 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:16 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:16 user nova-compute[74892]:   </cpu>
Nov 15 14:17:16 user nova-compute[74892]:   <devices>
Nov 15 14:17:16 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:16 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:16 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk"/>
Nov 15 14:17:16 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:16 user nova-compute[74892]:     </disk>
Nov 15 14:17:16 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:16 user nova-compute[74892]:       <mac address="fa:16:3e:ac:fa:ba"/>
Nov 15 14:17:16 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:16 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:16 user nova-compute[74892]:       <target dev="tap591e68d4-53"/>
Nov 15 14:17:16 user nova-compute[74892]:     </interface>
Nov 15 14:17:16 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:16 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/console.log" append="off"/>
Nov 15 14:17:16 user nova-compute[74892]:     </serial>
Nov 15 14:17:16 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:16 user nova-compute[74892]:     <video>
Nov 15 14:17:16 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:16 user nova-compute[74892]:     </video>
Nov 15 14:17:16 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:16 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:16 user nova-compute[74892]:     </rng>
Nov 15 14:17:16 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:16 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:16 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:16 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:16 user nova-compute[74892]:   </devices>
Nov 15 14:17:16 user nova-compute[74892]: </domain>
Nov 15 14:17:16 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1328408325',display_name='tempest-VolumesActionsTest-instance-1328408325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1328408325',id=8,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24aea1db854c42c0aa85018c5518b0a5',ramdisk_id='',reservation_id='r-0zsim08u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1307238287',owner_user_name='tempest-VolumesActionsTest-1307238287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:12Z,user_data=None,user_id='99f4ed77744d4cdb80cca826b6dc50b9',uuid=e03890e3-60d4-4719-a2db-7cc1fe245b11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converting VIF {"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:fa:ba,bridge_name='br-int',has_traffic_filtering=True,id=591e68d4-53a5-411c-b419-55b0b833abc5,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591e68d4-53') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG os_vif [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:fa:ba,bridge_name='br-int',has_traffic_filtering=True,id=591e68d4-53a5-411c-b419-55b0b833abc5,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591e68d4-53') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '110ea704-8e28-5e2e-9358-576dcaf14efc', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap591e68d4-53, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap591e68d4-53, col_values=(('qos', UUID('9a97e87b-d412-419a-8035-fa88ce1ce518')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap591e68d4-53, col_values=(('external_ids', {'iface-id': '591e68d4-53a5-411c-b419-55b0b833abc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:fa:ba', 'vm-uuid': 'e03890e3-60d4-4719-a2db-7cc1fe245b11'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: INFO os_vif [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:fa:ba,bridge_name='br-int',has_traffic_filtering=True,id=591e68d4-53a5-411c-b419-55b0b833abc5,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591e68d4-53')
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] No VIF found with MAC fa:16:3e:ac:fa:ba, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Successfully updated port: 1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquired lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Creating config drive at /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.config
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5z1ahga4 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [req-f667d2be-a1e9-4808-a20f-7aa83c1192bd req-82fdcb7b-2093-41a8-b0c2-c289411d4c84 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Updated VIF entry in instance network info cache for port 591e68d4-53a5-411c-b419-55b0b833abc5. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [req-f667d2be-a1e9-4808-a20f-7aa83c1192bd req-82fdcb7b-2093-41a8-b0c2-c289411d4c84 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Updating instance_info_cache with network_info: [{"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f667d2be-a1e9-4808-a20f-7aa83c1192bd req-82fdcb7b-2093-41a8-b0c2-c289411d4c84 service nova] Releasing lock "refresh_cache-e03890e3-60d4-4719-a2db-7cc1fe245b11" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5z1ahga4" returned: 0 in 0.088s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [req-2dadd98d-8d6a-4c3e-9f06-52843a33474b req-1fe76a4c-8368-43da-b002-92a1d71b8bf1 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updated VIF entry in instance network info cache for port 4c90eb33-2bf7-404b-a08e-c268206cdd69. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [req-2dadd98d-8d6a-4c3e-9f06-52843a33474b req-1fe76a4c-8368-43da-b002-92a1d71b8bf1 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2dadd98d-8d6a-4c3e-9f06-52843a33474b req-1fe76a4c-8368-43da-b002-92a1d71b8bf1 service nova] Releasing lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:17:17 user nova-compute[74892]: INFO nova.compute.claims [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Claim successful on node user
Nov 15 14:17:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-94e31d85-cc2a-4e07-abb2-5adb85e1e75e req-42bacefc-e322-453e-b40f-1cfcdcba49cf service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-changed-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-94e31d85-cc2a-4e07-abb2-5adb85e1e75e req-42bacefc-e322-453e-b40f-1cfcdcba49cf service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Refreshing instance network info cache due to event network-changed-1130e682-747f-499b-9d41-0ed33fd5e873. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-94e31d85-cc2a-4e07-abb2-5adb85e1e75e req-42bacefc-e322-453e-b40f-1cfcdcba49cf service nova] Acquiring lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Updating instance_info_cache with network_info: [{"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Releasing lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance network_info: |[{"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-94e31d85-cc2a-4e07-abb2-5adb85e1e75e req-42bacefc-e322-453e-b40f-1cfcdcba49cf service nova] Acquired lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.network.neutron [req-94e31d85-cc2a-4e07-abb2-5adb85e1e75e req-42bacefc-e322-453e-b40f-1cfcdcba49cf service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Refreshing network info cache for port 1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:17 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:17:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-94e31d85-cc2a-4e07-abb2-5adb85e1e75e req-42bacefc-e322-453e-b40f-1cfcdcba49cf service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Updated VIF entry in instance network info cache for port 1130e682-747f-499b-9d41-0ed33fd5e873. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-94e31d85-cc2a-4e07-abb2-5adb85e1e75e req-42bacefc-e322-453e-b40f-1cfcdcba49cf service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Updating instance_info_cache with network_info: [{"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-94e31d85-cc2a-4e07-abb2-5adb85e1e75e req-42bacefc-e322-453e-b40f-1cfcdcba49cf service nova] Releasing lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.policy [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '096eadc3f5844781a9185cceecd152c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eaa91d2ab4f47789867775b10bf2f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:17:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Creating image(s)
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "/opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "/opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "/opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "5c25142bc341047bc12f03d85488fc843a76b74c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "5c25142bc341047bc12f03d85488fc843a76b74c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.virt.images [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] 03f466fe-93e2-42a6-9436-442e4411dc78 was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:17:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c.part /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Successfully created port: 55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c.part /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c.converted" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "5c25142bc341047bc12f03d85488fc843a76b74c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.108s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "5c25142bc341047bc12f03d85488fc843a76b74c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "5c25142bc341047bc12f03d85488fc843a76b74c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c --force-share --output=json" returned: 0 in 0.243s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c,backing_fmt=raw /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-8f8f57c8-5e18-4f16-9727-7ce489141ead req-7ab2c6c7-b5bd-4a5d-93ec-e4e7dc969e55 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received event network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8f8f57c8-5e18-4f16-9727-7ce489141ead req-7ab2c6c7-b5bd-4a5d-93ec-e4e7dc969e55 service nova] Acquiring lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8f8f57c8-5e18-4f16-9727-7ce489141ead req-7ab2c6c7-b5bd-4a5d-93ec-e4e7dc969e55 service nova] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8f8f57c8-5e18-4f16-9727-7ce489141ead req-7ab2c6c7-b5bd-4a5d-93ec-e4e7dc969e55 service nova] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-8f8f57c8-5e18-4f16-9727-7ce489141ead req-7ab2c6c7-b5bd-4a5d-93ec-e4e7dc969e55 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] No waiting events found dispatching network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:20 user nova-compute[74892]: WARNING nova.compute.manager [req-8f8f57c8-5e18-4f16-9727-7ce489141ead req-7ab2c6c7-b5bd-4a5d-93ec-e4e7dc969e55 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received unexpected event network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 for instance with vm_state building and task_state spawning.
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c,backing_fmt=raw /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk 1073741824" returned: 0 in 0.115s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "5c25142bc341047bc12f03d85488fc843a76b74c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.436s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c --force-share --output=json" returned: 0 in 0.274s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Cannot resize image /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Ensure instance console log exists: /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Successfully updated port: 55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquired lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-1308625a-e211-4be4-9949-152d99fe2511 req-c14f344e-8566-4a44-8aaf-37809d5fc881 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received event network-changed-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-1308625a-e211-4be4-9949-152d99fe2511 req-c14f344e-8566-4a44-8aaf-37809d5fc881 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Refreshing instance network info cache due to event network-changed-55f1993f-e400-4ee5-afaf-01695532ac7c. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1308625a-e211-4be4-9949-152d99fe2511 req-c14f344e-8566-4a44-8aaf-37809d5fc881 service nova] Acquiring lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:21 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Instance spawned successfully.
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-e1538ea5-b9ef-436d-9e5e-745c83f0aa73 req-b0f6131d-5049-49a0-8a27-5ff2a36bbc3e service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1538ea5-b9ef-436d-9e5e-745c83f0aa73 req-b0f6131d-5049-49a0-8a27-5ff2a36bbc3e service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1538ea5-b9ef-436d-9e5e-745c83f0aa73 req-b0f6131d-5049-49a0-8a27-5ff2a36bbc3e service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1538ea5-b9ef-436d-9e5e-745c83f0aa73 req-b0f6131d-5049-49a0-8a27-5ff2a36bbc3e service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-e1538ea5-b9ef-436d-9e5e-745c83f0aa73 req-b0f6131d-5049-49a0-8a27-5ff2a36bbc3e service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:21 user nova-compute[74892]: WARNING nova.compute.manager [req-e1538ea5-b9ef-436d-9e5e-745c83f0aa73 req-b0f6131d-5049-49a0-8a27-5ff2a36bbc3e service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state active and task_state None.
Nov 15 14:17:21 user nova-compute[74892]: INFO nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Took 12.75 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:21 user nova-compute[74892]: INFO nova.compute.manager [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Took 14.11 seconds to build instance.
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Updating instance_info_cache with network_info: [{"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2ea7a4ac-a8e1-4549-936b-e29359676f7a tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.258s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Releasing lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Instance network_info: |[{"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1308625a-e211-4be4-9949-152d99fe2511 req-c14f344e-8566-4a44-8aaf-37809d5fc881 service nova] Acquired lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.network.neutron [req-1308625a-e211-4be4-9949-152d99fe2511 req-c14f344e-8566-4a44-8aaf-37809d5fc881 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Refreshing network info cache for port 55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Start _get_guest_xml network_info=[{"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:17:07Z,direct_url=<?>,disk_format='qcow2',id=03f466fe-93e2-42a6-9436-442e4411dc78,min_disk=0,min_ram=0,name='',owner='ead3578313be41598ad8e8c8a2229489',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:17:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'image_id': '03f466fe-93e2-42a6-9436-442e4411dc78'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:17:07Z,direct_url=<?>,disk_format='qcow2',id=03f466fe-93e2-42a6-9436-442e4411dc78,min_disk=0,min_ram=0,name='',owner='ead3578313be41598ad8e8c8a2229489',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:17:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-761296278',display_name='tempest-AttachSCSIVolumeTestJSON-server-761296278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-761296278',id=10,image_ref='03f466fe-93e2-42a6-9436-442e4411dc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdyCkccNt9recQkY0JLdgoDp2gq8GKZ9t91Bhq5aUCfvyG8ozpY2zbMOV58QRmswBmhPx6kT+Y4xlTTtS09jFYRNG3erpMsq6peV2Rdgows+HRcM1Q4TrLU20b0KfEB9A==',key_name='tempest-keypair-559847391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eaa91d2ab4f47789867775b10bf2f15',ramdisk_id='',reservation_id='r-01f5ru1y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='03f466fe-93e2-42a6-9436-442e4411dc78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114657185',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114657185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096eadc3f5844781a9185cceecd152c3',uuid=f95b420a-69c7-44c0-aba8-0462c1598841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Converting VIF {"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:5a,bridge_name='br-int',has_traffic_filtering=True,id=55f1993f-e400-4ee5-afaf-01695532ac7c,network=Network(fe6f0686-b87c-4831-b714-679752a10a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f1993f-e4') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.objects.instance [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lazy-loading 'pci_devices' on Instance uuid f95b420a-69c7-44c0-aba8-0462c1598841 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:21 user nova-compute[74892]:   <uuid>f95b420a-69c7-44c0-aba8-0462c1598841</uuid>
Nov 15 14:17:21 user nova-compute[74892]:   <name>instance-0000000a</name>
Nov 15 14:17:21 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:21 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:21 user nova-compute[74892]:   <metadata>
Nov 15 14:17:21 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:21 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:21 user nova-compute[74892]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-761296278</nova:name>
Nov 15 14:17:21 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:21</nova:creationTime>
Nov 15 14:17:21 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:21 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:21 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:21 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:21 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:21 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:21 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:21 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:21 user nova-compute[74892]:         <nova:user uuid="096eadc3f5844781a9185cceecd152c3">tempest-AttachSCSIVolumeTestJSON-2114657185-project-member</nova:user>
Nov 15 14:17:21 user nova-compute[74892]:         <nova:project uuid="7eaa91d2ab4f47789867775b10bf2f15">tempest-AttachSCSIVolumeTestJSON-2114657185</nova:project>
Nov 15 14:17:21 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:21 user nova-compute[74892]:       <nova:root type="image" uuid="03f466fe-93e2-42a6-9436-442e4411dc78"/>
Nov 15 14:17:21 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:21 user nova-compute[74892]:         <nova:port uuid="55f1993f-e400-4ee5-afaf-01695532ac7c">
Nov 15 14:17:21 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 14:17:21 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:21 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:21 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:21 user nova-compute[74892]:   </metadata>
Nov 15 14:17:21 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:21 user nova-compute[74892]:     <system>
Nov 15 14:17:21 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:21 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:21 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:21 user nova-compute[74892]:       <entry name="serial">f95b420a-69c7-44c0-aba8-0462c1598841</entry>
Nov 15 14:17:21 user nova-compute[74892]:       <entry name="uuid">f95b420a-69c7-44c0-aba8-0462c1598841</entry>
Nov 15 14:17:21 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:21 user nova-compute[74892]:     </system>
Nov 15 14:17:21 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:21 user nova-compute[74892]:   <os>
Nov 15 14:17:21 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:21 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:21 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:21 user nova-compute[74892]:   </os>
Nov 15 14:17:21 user nova-compute[74892]:   <features>
Nov 15 14:17:21 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:21 user nova-compute[74892]:     <apic/>
Nov 15 14:17:21 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:21 user nova-compute[74892]:   </features>
Nov 15 14:17:21 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:21 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:21 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:21 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:21 user nova-compute[74892]:   </clock>
Nov 15 14:17:21 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:21 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:21 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:21 user nova-compute[74892]:   </cpu>
Nov 15 14:17:21 user nova-compute[74892]:   <devices>
Nov 15 14:17:21 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:21 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:21 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk"/>
Nov 15 14:17:21 user nova-compute[74892]:       <target dev="sda" bus="scsi"/>
Nov 15 14:17:21 user nova-compute[74892]:       <address type="drive" controller="0" unit="0"/>
Nov 15 14:17:21 user nova-compute[74892]:     </disk>
Nov 15 14:17:21 user nova-compute[74892]:     <disk type="file" device="cdrom">
Nov 15 14:17:21 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 14:17:21 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk.config"/>
Nov 15 14:17:21 user nova-compute[74892]:       <target dev="sdb" bus="scsi"/>
Nov 15 14:17:21 user nova-compute[74892]:       <address type="drive" controller="0" unit="1"/>
Nov 15 14:17:21 user nova-compute[74892]:     </disk>
Nov 15 14:17:21 user nova-compute[74892]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 14:17:21 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:21 user nova-compute[74892]:       <mac address="fa:16:3e:f0:e7:5a"/>
Nov 15 14:17:21 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:21 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:21 user nova-compute[74892]:       <target dev="tap55f1993f-e4"/>
Nov 15 14:17:21 user nova-compute[74892]:     </interface>
Nov 15 14:17:21 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:21 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/console.log" append="off"/>
Nov 15 14:17:21 user nova-compute[74892]:     </serial>
Nov 15 14:17:21 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:21 user nova-compute[74892]:     <video>
Nov 15 14:17:21 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:21 user nova-compute[74892]:     </video>
Nov 15 14:17:21 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:21 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:21 user nova-compute[74892]:     </rng>
Nov 15 14:17:21 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:21 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:21 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:21 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:21 user nova-compute[74892]:   </devices>
Nov 15 14:17:21 user nova-compute[74892]: </domain>
Nov 15 14:17:21 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-761296278',display_name='tempest-AttachSCSIVolumeTestJSON-server-761296278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-761296278',id=10,image_ref='03f466fe-93e2-42a6-9436-442e4411dc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdyCkccNt9recQkY0JLdgoDp2gq8GKZ9t91Bhq5aUCfvyG8ozpY2zbMOV58QRmswBmhPx6kT+Y4xlTTtS09jFYRNG3erpMsq6peV2Rdgows+HRcM1Q4TrLU20b0KfEB9A==',key_name='tempest-keypair-559847391',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7eaa91d2ab4f47789867775b10bf2f15',ramdisk_id='',reservation_id='r-01f5ru1y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='03f466fe-93e2-42a6-9436-442e4411dc78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114657185',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114657185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096eadc3f5844781a9185cceecd152c3',uuid=f95b420a-69c7-44c0-aba8-0462c1598841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Converting VIF {"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:5a,bridge_name='br-int',has_traffic_filtering=True,id=55f1993f-e400-4ee5-afaf-01695532ac7c,network=Network(fe6f0686-b87c-4831-b714-679752a10a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f1993f-e4') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG os_vif [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:5a,bridge_name='br-int',has_traffic_filtering=True,id=55f1993f-e400-4ee5-afaf-01695532ac7c,network=Network(fe6f0686-b87c-4831-b714-679752a10a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f1993f-e4') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8640b87-6475-5db5-aa78-69d2526b2a01', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55f1993f-e4, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55f1993f-e4, col_values=(('qos', UUID('b9ce40d0-5820-4182-9cbf-b240bbc17511')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55f1993f-e4, col_values=(('external_ids', {'iface-id': '55f1993f-e400-4ee5-afaf-01695532ac7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e7:5a', 'vm-uuid': 'f95b420a-69c7-44c0-aba8-0462c1598841'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:21 user nova-compute[74892]: INFO os_vif [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e7:5a,bridge_name='br-int',has_traffic_filtering=True,id=55f1993f-e400-4ee5-afaf-01695532ac7c,network=Network(fe6f0686-b87c-4831-b714-679752a10a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f1993f-e4')
Nov 15 14:17:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-c332d263-d684-4afe-9f5d-f9d4815d143f req-4f594e8d-e297-42fe-a6c8-d020ed342574 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received event network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c332d263-d684-4afe-9f5d-f9d4815d143f req-4f594e8d-e297-42fe-a6c8-d020ed342574 service nova] Acquiring lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c332d263-d684-4afe-9f5d-f9d4815d143f req-4f594e8d-e297-42fe-a6c8-d020ed342574 service nova] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c332d263-d684-4afe-9f5d-f9d4815d143f req-4f594e8d-e297-42fe-a6c8-d020ed342574 service nova] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-c332d263-d684-4afe-9f5d-f9d4815d143f req-4f594e8d-e297-42fe-a6c8-d020ed342574 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] No waiting events found dispatching network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:22 user nova-compute[74892]: WARNING nova.compute.manager [req-c332d263-d684-4afe-9f5d-f9d4815d143f req-4f594e8d-e297-42fe-a6c8-d020ed342574 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received unexpected event network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 for instance with vm_state building and task_state spawning.
Nov 15 14:17:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] No BDM found with device name sda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] No VIF found with MAC fa:16:3e:f0:e7:5a, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Using config drive
Nov 15 14:17:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Creating config drive at /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk.config
Nov 15 14:17:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqb6oont5 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.network.neutron [req-1308625a-e211-4be4-9949-152d99fe2511 req-c14f344e-8566-4a44-8aaf-37809d5fc881 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Updated VIF entry in instance network info cache for port 55f1993f-e400-4ee5-afaf-01695532ac7c. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.network.neutron [req-1308625a-e211-4be4-9949-152d99fe2511 req-c14f344e-8566-4a44-8aaf-37809d5fc881 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Updating instance_info_cache with network_info: [{"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqb6oont5" returned: 0 in 0.060s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1308625a-e211-4be4-9949-152d99fe2511 req-c14f344e-8566-4a44-8aaf-37809d5fc881 service nova] Releasing lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:17:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Instance spawned successfully.
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:22 user nova-compute[74892]: INFO nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Took 12.85 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:17:23 user nova-compute[74892]: INFO nova.compute.claims [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Claim successful on node user
Nov 15 14:17:23 user nova-compute[74892]: INFO nova.compute.manager [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Took 14.61 seconds to build instance.
Nov 15 14:17:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-960a866c-6876-4c07-b121-3f20b6e44af9 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.794s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Instance spawned successfully.
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Instance spawned successfully.
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-349d4aa7-c2d0-4d83-9be6-ca315ac62360 req-d526b566-4b8c-4593-8e92-9ccb90aa8b3c service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-349d4aa7-c2d0-4d83-9be6-ca315ac62360 req-d526b566-4b8c-4593-8e92-9ccb90aa8b3c service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-349d4aa7-c2d0-4d83-9be6-ca315ac62360 req-d526b566-4b8c-4593-8e92-9ccb90aa8b3c service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-349d4aa7-c2d0-4d83-9be6-ca315ac62360 req-d526b566-4b8c-4593-8e92-9ccb90aa8b3c service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-349d4aa7-c2d0-4d83-9be6-ca315ac62360 req-d526b566-4b8c-4593-8e92-9ccb90aa8b3c service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:23 user nova-compute[74892]: WARNING nova.compute.manager [req-349d4aa7-c2d0-4d83-9be6-ca315ac62360 req-d526b566-4b8c-4593-8e92-9ccb90aa8b3c service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state active and task_state None.
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:23 user nova-compute[74892]: INFO nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Took 10.79 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:23 user nova-compute[74892]: INFO nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Took 11.93 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:23 user nova-compute[74892]: INFO nova.compute.manager [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Took 13.06 seconds to build instance.
Nov 15 14:17:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-41d09b76-dc00-44cd-9395-eb7ee2ed7fd6 tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.592s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:23 user nova-compute[74892]: INFO nova.compute.manager [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Took 13.74 seconds to build instance.
Nov 15 14:17:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3e8d490-3699-4345-aac7-b50210d78fbf tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.982s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.301s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:17:24 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Creating image(s)
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Ensure instance console log exists: /opt/stack/data/nova/instances/c155e78a-3bb5-46b1-ac34-0bace9450318/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Start _get_guest_xml network_info=[{"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c155e78a-3bb5-46b1-ac34-0bace9450318', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'serial': 'f2ba5dc0-2823-48ed-98ff-bc471a20f00a'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '84710ffb-4b6b-4bf5-a403-3c917d7e8406', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:17:24 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connector [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Factory for ISCSI on None {{(pid=74892) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.015s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:17:24 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:17:24 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:17:24 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260" returned: 21 in 0.127s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db3eab2-7464-4ded-b53b-7d6b50a45cc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:17:24 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-3459d1e5-7cb3-4964-944c-f36c08255b63 req-1e4333e7-c3fa-4bf5-bd6f-b9185029188c service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received event network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3459d1e5-7cb3-4964-944c-f36c08255b63 req-1e4333e7-c3fa-4bf5-bd6f-b9185029188c service nova] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3459d1e5-7cb3-4964-944c-f36c08255b63 req-1e4333e7-c3fa-4bf5-bd6f-b9185029188c service nova] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3459d1e5-7cb3-4964-944c-f36c08255b63 req-1e4333e7-c3fa-4bf5-bd6f-b9185029188c service nova] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-3459d1e5-7cb3-4964-944c-f36c08255b63 req-1e4333e7-c3fa-4bf5-bd6f-b9185029188c service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] No waiting events found dispatching network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:24 user nova-compute[74892]: WARNING nova.compute.manager [req-3459d1e5-7cb3-4964-944c-f36c08255b63 req-1e4333e7-c3fa-4bf5-bd6f-b9185029188c service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received unexpected event network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c for instance with vm_state building and task_state spawning.
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.063s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf940b-2650-4862-a16d-81709867b54c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a] added
Nov 15 14:17:24 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ba7877-bb13-40a8-87f1-42257fae9186]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG nova.policy [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e743ddbc38f640fe8740c34e140abb6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2e5e6b12fde47ccbd8f966bce629b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[90eac67b-2607-4bb3-b0c1-fbf2ad9f358a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v purWlUhz {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v purWlUhz" returned: 0 in 0.037s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9372480-1665-4ade-a151-09116a3dd591]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:17:25 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Creating image(s)
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "/opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "/opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "/opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'purWlUhz'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[85925c83-0a39-4b89-ba20-780b27099ce7]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[348129af-e592-44bf-923e-962da8e9fce8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:17:25 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:17:25 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:17:25 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 14:17:25 user nova-compute[74892]: 
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefb15e8-7f6a-472c-865a-2982b0ab40f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260]
Nov 15 14:17:25 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260] successful.
Nov 15 14:17:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[61395f77-79b8-4c9f-a229-9c179c4c92a6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bda0e34-c21f-462b-8442-c1e481ff61f5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.682s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.040s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[47caa27e-53b4-4c4b-bbf7-6b0255baef95]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.360s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.256s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk 1073741824" returned: 0 in 0.144s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.405s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.244s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Cannot resize image /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Ensure instance console log exists: /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Successfully created port: 886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.750s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] <== connect_volume: return (1753ms) {'type': 'block', 'scsi_wwn': '23265366265613363', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265366265613363', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-336786677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336786677',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2KiKDdXeNAqvnhWOe4IokiJsPszuyRac/hr6RiPGlUzitCsmqUIxYtGGZBpsS3bdXKowuUuVkKL67IqO63L//BO28Js1mUKMzps/11gW1kNdrY79SZ72XLSRRQSAhs3A==',key_name='tempest-keypair-1595477803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bc8d0616234fdf92d29834bda6d906',ramdisk_id='',reservation_id='r-3s6xwekg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-458086644',owner_user_name='tempest-ServerActionsV293TestJSON-458086644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f2936bf65e4ca3be5b6f81718d8a91',uuid=c155e78a-3bb5-46b1-ac34-0bace9450318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converting VIF {"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lazy-loading 'pci_devices' on Instance uuid c155e78a-3bb5-46b1-ac34-0bace9450318 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:26 user nova-compute[74892]:   <uuid>c155e78a-3bb5-46b1-ac34-0bace9450318</uuid>
Nov 15 14:17:26 user nova-compute[74892]:   <name>instance-00000009</name>
Nov 15 14:17:26 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:26 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:26 user nova-compute[74892]:   <metadata>
Nov 15 14:17:26 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:26 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:26 user nova-compute[74892]:       <nova:name>tempest-ServerActionsV293TestJSON-server-336786677</nova:name>
Nov 15 14:17:26 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:24</nova:creationTime>
Nov 15 14:17:26 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:26 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:26 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:26 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:26 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:26 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:26 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:26 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:26 user nova-compute[74892]:         <nova:user uuid="92f2936bf65e4ca3be5b6f81718d8a91">tempest-ServerActionsV293TestJSON-458086644-project-member</nova:user>
Nov 15 14:17:26 user nova-compute[74892]:         <nova:project uuid="92bc8d0616234fdf92d29834bda6d906">tempest-ServerActionsV293TestJSON-458086644</nova:project>
Nov 15 14:17:26 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:26 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:26 user nova-compute[74892]:         <nova:port uuid="1130e682-747f-499b-9d41-0ed33fd5e873">
Nov 15 14:17:26 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:17:26 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:26 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:26 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:26 user nova-compute[74892]:   </metadata>
Nov 15 14:17:26 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:26 user nova-compute[74892]:     <system>
Nov 15 14:17:26 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:26 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:26 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:26 user nova-compute[74892]:       <entry name="serial">c155e78a-3bb5-46b1-ac34-0bace9450318</entry>
Nov 15 14:17:26 user nova-compute[74892]:       <entry name="uuid">c155e78a-3bb5-46b1-ac34-0bace9450318</entry>
Nov 15 14:17:26 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:26 user nova-compute[74892]:     </system>
Nov 15 14:17:26 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:26 user nova-compute[74892]:   <os>
Nov 15 14:17:26 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:26 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:26 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:26 user nova-compute[74892]:   </os>
Nov 15 14:17:26 user nova-compute[74892]:   <features>
Nov 15 14:17:26 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:26 user nova-compute[74892]:     <apic/>
Nov 15 14:17:26 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:26 user nova-compute[74892]:   </features>
Nov 15 14:17:26 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:26 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:26 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:26 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:26 user nova-compute[74892]:   </clock>
Nov 15 14:17:26 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:26 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:26 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:26 user nova-compute[74892]:   </cpu>
Nov 15 14:17:26 user nova-compute[74892]:   <devices>
Nov 15 14:17:26 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:17:26 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:17:26 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:17:26 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:26 user nova-compute[74892]:       <serial>f2ba5dc0-2823-48ed-98ff-bc471a20f00a</serial>
Nov 15 14:17:26 user nova-compute[74892]:     </disk>
Nov 15 14:17:26 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:26 user nova-compute[74892]:       <mac address="fa:16:3e:4c:c7:00"/>
Nov 15 14:17:26 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:26 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:26 user nova-compute[74892]:       <target dev="tap1130e682-74"/>
Nov 15 14:17:26 user nova-compute[74892]:     </interface>
Nov 15 14:17:26 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:26 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/c155e78a-3bb5-46b1-ac34-0bace9450318/console.log" append="off"/>
Nov 15 14:17:26 user nova-compute[74892]:     </serial>
Nov 15 14:17:26 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:26 user nova-compute[74892]:     <video>
Nov 15 14:17:26 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:26 user nova-compute[74892]:     </video>
Nov 15 14:17:26 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:26 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:26 user nova-compute[74892]:     </rng>
Nov 15 14:17:26 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:26 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:26 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:26 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:26 user nova-compute[74892]:   </devices>
Nov 15 14:17:26 user nova-compute[74892]: </domain>
Nov 15 14:17:26 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-336786677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336786677',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2KiKDdXeNAqvnhWOe4IokiJsPszuyRac/hr6RiPGlUzitCsmqUIxYtGGZBpsS3bdXKowuUuVkKL67IqO63L//BO28Js1mUKMzps/11gW1kNdrY79SZ72XLSRRQSAhs3A==',key_name='tempest-keypair-1595477803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92bc8d0616234fdf92d29834bda6d906',ramdisk_id='',reservation_id='r-3s6xwekg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-458086644',owner_user_name='tempest-ServerActionsV293TestJSON-458086644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f2936bf65e4ca3be5b6f81718d8a91',uuid=c155e78a-3bb5-46b1-ac34-0bace9450318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converting VIF {"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG os_vif [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7b24285-eaa9-53c0-90f9-c9f1289bb51b', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1130e682-74, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1130e682-74, col_values=(('qos', UUID('cbe1849c-a692-4cb5-94d3-0da05c978f31')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1130e682-74, col_values=(('external_ids', {'iface-id': '1130e682-747f-499b-9d41-0ed33fd5e873', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:c7:00', 'vm-uuid': 'c155e78a-3bb5-46b1-ac34-0bace9450318'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:26 user nova-compute[74892]: INFO os_vif [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74')
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] No VIF found with MAC fa:16:3e:4c:c7:00, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-350c2dae-433d-444e-9959-82c2f399ca50 req-da16697f-4f2f-4762-91a4-707e1ba4deb0 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received event network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-350c2dae-433d-444e-9959-82c2f399ca50 req-da16697f-4f2f-4762-91a4-707e1ba4deb0 service nova] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-350c2dae-433d-444e-9959-82c2f399ca50 req-da16697f-4f2f-4762-91a4-707e1ba4deb0 service nova] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-350c2dae-433d-444e-9959-82c2f399ca50 req-da16697f-4f2f-4762-91a4-707e1ba4deb0 service nova] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-350c2dae-433d-444e-9959-82c2f399ca50 req-da16697f-4f2f-4762-91a4-707e1ba4deb0 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] No waiting events found dispatching network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:26 user nova-compute[74892]: WARNING nova.compute.manager [req-350c2dae-433d-444e-9959-82c2f399ca50 req-da16697f-4f2f-4762-91a4-707e1ba4deb0 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received unexpected event network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c for instance with vm_state building and task_state spawning.
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Successfully updated port: 886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:27 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Instance spawned successfully.
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquired lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-181b355e-15ea-446b-9886-93d0ce6dece3 req-2b1b61fd-ebe8-4753-ba88-afd05db2647e service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received event network-changed-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-181b355e-15ea-446b-9886-93d0ce6dece3 req-2b1b61fd-ebe8-4753-ba88-afd05db2647e service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Refreshing instance network info cache due to event network-changed-886325ed-370a-409c-9ffa-281542e4ecae. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-181b355e-15ea-446b-9886-93d0ce6dece3 req-2b1b61fd-ebe8-4753-ba88-afd05db2647e service nova] Acquiring lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:27 user nova-compute[74892]: INFO nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Took 9.13 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:27 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:27 user nova-compute[74892]: INFO nova.compute.manager [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Took 10.11 seconds to build instance.
Nov 15 14:17:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f33c56d3-e131-4bae-a170-0ae515ee89e9 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.260s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-2804fa4d-72a0-4edd-8ead-ab0db7a3b727 req-21633387-01bf-48ce-95f5-d5f6bfff814a service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received event network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2804fa4d-72a0-4edd-8ead-ab0db7a3b727 req-21633387-01bf-48ce-95f5-d5f6bfff814a service nova] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2804fa4d-72a0-4edd-8ead-ab0db7a3b727 req-21633387-01bf-48ce-95f5-d5f6bfff814a service nova] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2804fa4d-72a0-4edd-8ead-ab0db7a3b727 req-21633387-01bf-48ce-95f5-d5f6bfff814a service nova] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-2804fa4d-72a0-4edd-8ead-ab0db7a3b727 req-21633387-01bf-48ce-95f5-d5f6bfff814a service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] No waiting events found dispatching network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:28 user nova-compute[74892]: WARNING nova.compute.manager [req-2804fa4d-72a0-4edd-8ead-ab0db7a3b727 req-21633387-01bf-48ce-95f5-d5f6bfff814a service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received unexpected event network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 for instance with vm_state active and task_state None.
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Updating instance_info_cache with network_info: [{"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Releasing lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Instance network_info: |[{"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-181b355e-15ea-446b-9886-93d0ce6dece3 req-2b1b61fd-ebe8-4753-ba88-afd05db2647e service nova] Acquired lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.network.neutron [req-181b355e-15ea-446b-9886-93d0ce6dece3 req-2b1b61fd-ebe8-4753-ba88-afd05db2647e service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Refreshing network info cache for port 886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Start _get_guest_xml network_info=[{"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:28 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:28 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-407695004',display_name='tempest-VolumesAssistedSnapshotsTest-server-407695004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-407695004',id=11,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/2TyPHb+ApViwH6OCvQfZeyn8up/EsqGlJif4SfyY1cnsGjfa2lp6DHEzQ2SX+8afnSdB7YPbBBN4FqFrAlKO+imtyniCVXRiUyestvDYKlxGeP0nsbSN17UKKyW48A==',key_name='tempest-keypair-130684183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2e5e6b12fde47ccbd8f966bce629b03',ramdisk_id='',reservation_id='r-nb4eqmvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-318542867',owner_user_name='tempest-VolumesAssistedSnapshotsTest-318542867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743ddbc38f640fe8740c34e140abb6d',uuid=92b19e94-da7c-4d74-a89a-ea5c709e573c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Converting VIF {"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=886325ed-370a-409c-9ffa-281542e4ecae,network=Network(26ae8837-a041-4097-8b89-ff3c120aed86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886325ed-37') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lazy-loading 'pci_devices' on Instance uuid 92b19e94-da7c-4d74-a89a-ea5c709e573c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:28 user nova-compute[74892]:   <uuid>92b19e94-da7c-4d74-a89a-ea5c709e573c</uuid>
Nov 15 14:17:28 user nova-compute[74892]:   <name>instance-0000000b</name>
Nov 15 14:17:28 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:28 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:28 user nova-compute[74892]:   <metadata>
Nov 15 14:17:28 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:28 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:28 user nova-compute[74892]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-407695004</nova:name>
Nov 15 14:17:28 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:28</nova:creationTime>
Nov 15 14:17:28 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:28 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:28 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:28 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:28 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:28 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:28 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:28 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:28 user nova-compute[74892]:         <nova:user uuid="e743ddbc38f640fe8740c34e140abb6d">tempest-VolumesAssistedSnapshotsTest-318542867-project-member</nova:user>
Nov 15 14:17:28 user nova-compute[74892]:         <nova:project uuid="e2e5e6b12fde47ccbd8f966bce629b03">tempest-VolumesAssistedSnapshotsTest-318542867</nova:project>
Nov 15 14:17:28 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:28 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:28 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:28 user nova-compute[74892]:         <nova:port uuid="886325ed-370a-409c-9ffa-281542e4ecae">
Nov 15 14:17:28 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 14:17:28 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:28 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:28 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:28 user nova-compute[74892]:   </metadata>
Nov 15 14:17:28 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:28 user nova-compute[74892]:     <system>
Nov 15 14:17:28 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:28 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:28 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:28 user nova-compute[74892]:       <entry name="serial">92b19e94-da7c-4d74-a89a-ea5c709e573c</entry>
Nov 15 14:17:28 user nova-compute[74892]:       <entry name="uuid">92b19e94-da7c-4d74-a89a-ea5c709e573c</entry>
Nov 15 14:17:28 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:28 user nova-compute[74892]:     </system>
Nov 15 14:17:28 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:28 user nova-compute[74892]:   <os>
Nov 15 14:17:28 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:28 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:28 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:28 user nova-compute[74892]:   </os>
Nov 15 14:17:28 user nova-compute[74892]:   <features>
Nov 15 14:17:28 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:28 user nova-compute[74892]:     <apic/>
Nov 15 14:17:28 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:28 user nova-compute[74892]:   </features>
Nov 15 14:17:28 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:28 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:28 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:28 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:28 user nova-compute[74892]:   </clock>
Nov 15 14:17:28 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:28 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:28 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:28 user nova-compute[74892]:   </cpu>
Nov 15 14:17:28 user nova-compute[74892]:   <devices>
Nov 15 14:17:28 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:17:28 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:17:28 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk"/>
Nov 15 14:17:28 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:28 user nova-compute[74892]:     </disk>
Nov 15 14:17:28 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:28 user nova-compute[74892]:       <mac address="fa:16:3e:1a:d3:cc"/>
Nov 15 14:17:28 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:28 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:28 user nova-compute[74892]:       <target dev="tap886325ed-37"/>
Nov 15 14:17:28 user nova-compute[74892]:     </interface>
Nov 15 14:17:28 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:28 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/console.log" append="off"/>
Nov 15 14:17:28 user nova-compute[74892]:     </serial>
Nov 15 14:17:28 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:28 user nova-compute[74892]:     <video>
Nov 15 14:17:28 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:28 user nova-compute[74892]:     </video>
Nov 15 14:17:28 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:28 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:28 user nova-compute[74892]:     </rng>
Nov 15 14:17:28 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:28 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:28 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:28 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:28 user nova-compute[74892]:   </devices>
Nov 15 14:17:28 user nova-compute[74892]: </domain>
Nov 15 14:17:28 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-407695004',display_name='tempest-VolumesAssistedSnapshotsTest-server-407695004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-407695004',id=11,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/2TyPHb+ApViwH6OCvQfZeyn8up/EsqGlJif4SfyY1cnsGjfa2lp6DHEzQ2SX+8afnSdB7YPbBBN4FqFrAlKO+imtyniCVXRiUyestvDYKlxGeP0nsbSN17UKKyW48A==',key_name='tempest-keypair-130684183',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2e5e6b12fde47ccbd8f966bce629b03',ramdisk_id='',reservation_id='r-nb4eqmvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-318542867',owner_user_name='tempest-VolumesAssistedSnapshotsTest-318542867-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743ddbc38f640fe8740c34e140abb6d',uuid=92b19e94-da7c-4d74-a89a-ea5c709e573c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Converting VIF {"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=886325ed-370a-409c-9ffa-281542e4ecae,network=Network(26ae8837-a041-4097-8b89-ff3c120aed86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886325ed-37') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG os_vif [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=886325ed-370a-409c-9ffa-281542e4ecae,network=Network(26ae8837-a041-4097-8b89-ff3c120aed86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886325ed-37') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40557746-e92b-5ab5-8847-e4366c79b4a5', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap886325ed-37, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap886325ed-37, col_values=(('qos', UUID('a66b827f-b1f9-4807-92c7-298ff07175f7')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap886325ed-37, col_values=(('external_ids', {'iface-id': '886325ed-370a-409c-9ffa-281542e4ecae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:d3:cc', 'vm-uuid': '92b19e94-da7c-4d74-a89a-ea5c709e573c'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:28 user nova-compute[74892]: INFO os_vif [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=886325ed-370a-409c-9ffa-281542e4ecae,network=Network(26ae8837-a041-4097-8b89-ff3c120aed86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886325ed-37')
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] No VIF found with MAC fa:16:3e:1a:d3:cc, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:29 user nova-compute[74892]: DEBUG nova.network.neutron [req-181b355e-15ea-446b-9886-93d0ce6dece3 req-2b1b61fd-ebe8-4753-ba88-afd05db2647e service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Updated VIF entry in instance network info cache for port 886325ed-370a-409c-9ffa-281542e4ecae. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:29 user nova-compute[74892]: DEBUG nova.network.neutron [req-181b355e-15ea-446b-9886-93d0ce6dece3 req-2b1b61fd-ebe8-4753-ba88-afd05db2647e service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Updating instance_info_cache with network_info: [{"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-181b355e-15ea-446b-9886-93d0ce6dece3 req-2b1b61fd-ebe8-4753-ba88-afd05db2647e service nova] Releasing lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received event network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] No waiting events found dispatching network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:30 user nova-compute[74892]: WARNING nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received unexpected event network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 for instance with vm_state active and task_state None.
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] No waiting events found dispatching network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:30 user nova-compute[74892]: WARNING nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received unexpected event network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 for instance with vm_state active and task_state None.
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] No waiting events found dispatching network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:30 user nova-compute[74892]: WARNING nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received unexpected event network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 for instance with vm_state active and task_state None.
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] No waiting events found dispatching network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:30 user nova-compute[74892]: WARNING nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received unexpected event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 for instance with vm_state building and task_state spawning.
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] No waiting events found dispatching network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:30 user nova-compute[74892]: WARNING nova.compute.manager [req-ed4f8a19-54a5-4069-9375-342348dfb657 req-8be740f8-502d-44d8-8b53-350ae1b51218 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received unexpected event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 for instance with vm_state building and task_state spawning.
Nov 15 14:17:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance spawned successfully.
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:32 user nova-compute[74892]: INFO nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Took 8.28 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:32 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:32 user nova-compute[74892]: INFO nova.compute.manager [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Took 22.40 seconds to build instance.
Nov 15 14:17:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ddbbf25-0ef8-4b87-9ea3-c25f0ecedade tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.730s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:17:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Instance spawned successfully.
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:17:33 user nova-compute[74892]: INFO nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Took 8.91 seconds to spawn the instance on the hypervisor.
Nov 15 14:17:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:17:34 user nova-compute[74892]: INFO nova.compute.manager [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Took 11.21 seconds to build instance.
Nov 15 14:17:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3935d82c-88a6-4048-9f26-870af7b35295 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.525s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "a44f26ed-88ff-486e-929f-141e51009aad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:17:34 user nova-compute[74892]: INFO nova.compute.claims [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Claim successful on node user
Nov 15 14:17:35 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:35 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.873s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:17:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:17:35 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:17:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:17:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG nova.policy [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33c01685d0044a389ad69dcdf99737e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '532a7e7ab572451690b43490840b3a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:17:36 user nova-compute[74892]: INFO nova.virt.block_device [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Booting with volume 8aa31c72-2591-421d-81a8-6b3978425f8b at /dev/vda
Nov 15 14:17:36 user nova-compute[74892]: DEBUG os_brick.utils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4104e1-7b3a-49a7-9d5c-2063e5f74713]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c253755-060c-4436-8d9b-709daa3c4226]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0460d8-629e-4fa4-9729-f4f7656fd87b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[db50facb-e62f-43a2-a70b-0cdc4b9e0854]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:17:36 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fcd1c8-90fe-4e98-b41e-fdcbb34d0148]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG os_brick.utils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating existing volume attachment record: 102363c5-3ba0-4925-9526-21d40e75dd67 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully created port: c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:17:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Skipping network cache update for instance because it is Building. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid a87f39af-29c7-40ee-86c9-ed04a07b9d2e {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully created port: 6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updating instance_info_cache with network_info: [{"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:37 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully created port: acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully created port: 67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully created port: fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully updated port: c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-6c9c2ad1-dd54-44f0-b096-6f98ecaf16a7 req-2d39eda5-a805-48fa-9e93-eeb24f573b4f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-changed-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-6c9c2ad1-dd54-44f0-b096-6f98ecaf16a7 req-2d39eda5-a805-48fa-9e93-eeb24f573b4f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing instance network info cache due to event network-changed-c1621ad1-87e8-436b-830e-a48822c95049. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6c9c2ad1-dd54-44f0-b096-6f98ecaf16a7 req-2d39eda5-a805-48fa-9e93-eeb24f573b4f service nova] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6c9c2ad1-dd54-44f0-b096-6f98ecaf16a7 req-2d39eda5-a805-48fa-9e93-eeb24f573b4f service nova] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG nova.network.neutron [req-6c9c2ad1-dd54-44f0-b096-6f98ecaf16a7 req-2d39eda5-a805-48fa-9e93-eeb24f573b4f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing network info cache for port c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG nova.network.neutron [req-6c9c2ad1-dd54-44f0-b096-6f98ecaf16a7 req-2d39eda5-a805-48fa-9e93-eeb24f573b4f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG nova.network.neutron [req-6c9c2ad1-dd54-44f0-b096-6f98ecaf16a7 req-2d39eda5-a805-48fa-9e93-eeb24f573b4f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6c9c2ad1-dd54-44f0-b096-6f98ecaf16a7 req-2d39eda5-a805-48fa-9e93-eeb24f573b4f service nova] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully updated port: 67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully updated port: 5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully updated port: 6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-changed-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing instance network info cache due to event network-changed-67540ebd-51b4-4a04-9900-3c0d1e8d4364. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing network info cache for port 67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-changed-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing instance network info cache due to event network-changed-5bdbd29b-ae5f-41f5-880a-947f3cd55259. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing network info cache for port 5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully updated port: acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.network.neutron [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:43 user nova-compute[74892]: INFO nova.virt.block_device [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Booting with volume 2253dba5-f94a-4d96-8a6c-e35ff352ce82 at /dev/vdb
Nov 15 14:17:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7195MB free_disk=25.605117797851562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b96c38-3ffc-49f7-a311-d4567d863b3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4f4822-027d-451f-91ec-d238e12587c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee79766-065d-44ea-8f9a-65f0e250ec2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[817cae32-2d8f-46c7-a682-55071d5e93f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.network.neutron [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a642fd2c-0e81-48e3-9033-5bdcdb6e2ff8 req-deb8f486-a377-4bc9-9720-d388d2500947 service nova] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:17:43 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:17:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[76457809-4430-4464-957d-635746280e94]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating existing volume attachment record: 91d02da4-4e19-4718-bf63-2cfc388dfc21 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a038db7d-023b-44ac-a74e-be018b0b6492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e03890e3-60d4-4719-a2db-7cc1fe245b11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c155e78a-3bb5-46b1-ac34-0bace9450318 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance f95b420a-69c7-44c0-aba8-0462c1598841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 92b19e94-da7c-4d74-a89a-ea5c709e573c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a44f26ed-88ff-486e-929f-141e51009aad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:17:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.939s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-changed-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing instance network info cache due to event network-changed-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing network info cache for port 6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully updated port: 67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Successfully updated port: fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.network.neutron [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-changed-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing instance network info cache due to event network-changed-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.network.neutron [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing network info cache for port acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-8b9bd3c6-b115-42f6-a26c-644534df4326 req-f8d2f3de-6f18-4f80-b233-a4f4dd9f799e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-changed-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-8b9bd3c6-b115-42f6-a26c-644534df4326 req-f8d2f3de-6f18-4f80-b233-a4f4dd9f799e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing instance network info cache due to event network-changed-fa49ca22-dd97-4732-9e2d-b579298c6f58. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8b9bd3c6-b115-42f6-a26c-644534df4326 req-f8d2f3de-6f18-4f80-b233-a4f4dd9f799e service nova] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.network.neutron [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.network.neutron [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4972cc4c-5b1a-4a18-9b6c-2c2b71e800d9 req-68004dd1-ba03-4651-ac30-7a5e1eb7743e service nova] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:17:45 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:17:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-91c4c97b-e16f-47fd-8dd1-bf9984eb3474 req-14f7b1f6-0f70-42bc-a0eb-f9e29bca5587 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-changed-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-91c4c97b-e16f-47fd-8dd1-bf9984eb3474 req-14f7b1f6-0f70-42bc-a0eb-f9e29bca5587 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing instance network info cache due to event network-changed-67d418cb-b295-4fe3-857d-fa7eb1244168. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:17:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-91c4c97b-e16f-47fd-8dd1-bf9984eb3474 req-14f7b1f6-0f70-42bc-a0eb-f9e29bca5587 service nova] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:17:47 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [{"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance network_info: |[{"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:17:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8b9bd3c6-b115-42f6-a26c-644534df4326 req-f8d2f3de-6f18-4f80-b233-a4f4dd9f799e service nova] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:47 user nova-compute[74892]: DEBUG nova.network.neutron [req-8b9bd3c6-b115-42f6-a26c-644534df4326 req-f8d2f3de-6f18-4f80-b233-a4f4dd9f799e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing network info cache for port fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:47 user nova-compute[74892]: DEBUG nova.network.neutron [req-8b9bd3c6-b115-42f6-a26c-644534df4326 req-f8d2f3de-6f18-4f80-b233-a4f4dd9f799e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updated VIF entry in instance network info cache for port fa49ca22-dd97-4732-9e2d-b579298c6f58. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:47 user nova-compute[74892]: DEBUG nova.network.neutron [req-8b9bd3c6-b115-42f6-a26c-644534df4326 req-f8d2f3de-6f18-4f80-b233-a4f4dd9f799e service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [{"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8b9bd3c6-b115-42f6-a26c-644534df4326 req-f8d2f3de-6f18-4f80-b233-a4f4dd9f799e service nova] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-91c4c97b-e16f-47fd-8dd1-bf9984eb3474 req-14f7b1f6-0f70-42bc-a0eb-f9e29bca5587 service nova] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:17:48 user nova-compute[74892]: DEBUG nova.network.neutron [req-91c4c97b-e16f-47fd-8dd1-bf9984eb3474 req-14f7b1f6-0f70-42bc-a0eb-f9e29bca5587 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing network info cache for port 67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:17:48 user nova-compute[74892]: DEBUG nova.network.neutron [req-91c4c97b-e16f-47fd-8dd1-bf9984eb3474 req-14f7b1f6-0f70-42bc-a0eb-f9e29bca5587 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updated VIF entry in instance network info cache for port 67d418cb-b295-4fe3-857d-fa7eb1244168. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:17:48 user nova-compute[74892]: DEBUG nova.network.neutron [req-91c4c97b-e16f-47fd-8dd1-bf9984eb3474 req-14f7b1f6-0f70-42bc-a0eb-f9e29bca5587 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [{"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:17:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-91c4c97b-e16f-47fd-8dd1-bf9984eb3474 req-14f7b1f6-0f70-42bc-a0eb-f9e29bca5587 service nova] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:17:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:49 user nova-compute[74892]: INFO nova.virt.block_device [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Booting with volume 106e4496-4dc4-46fb-92b9-9d944c424427 at /dev/vdc
Nov 15 14:17:49 user nova-compute[74892]: DEBUG os_brick.utils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[360e6635-2713-4ae8-a035-fda88359c91d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5997162-d935-445f-a418-f49e96d71585]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c96c4c-34f6-4c0d-a266-06030abecfea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[29667b80-2b47-45e8-9b5d-4eb45fd234a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:17:49 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:17:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[95255212-fa74-476b-81e7-edbe4d18db93]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG os_brick.utils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:17:49 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating existing volume attachment record: 964c3625-cf80-4843-9644-86a35dcaf9dd {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:17:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:17:54 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Creating image(s)
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Ensure instance console log exists: /opt/stack/data/nova/instances/a44f26ed-88ff-486e-929f-141e51009aad/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Start _get_guest_xml network_info=[{"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBfdiAJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a44f26ed-88ff-486e-929f-141e51009aad', 'attached_at': '', 'detached_at': '', 'volume_id': '8aa31c72-2591-421d-81a8-6b3978425f8b', 'serial': '8aa31c72-2591-421d-81a8-6b3978425f8b'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '102363c5-3ba0-4925-9526-21d40e75dd67', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyZFctih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a44f26ed-88ff-486e-929f-141e51009aad', 'attached_at': '', 'detached_at': '', 'volume_id': '2253dba5-f94a-4d96-8a6c-e35ff352ce82', 'serial': '2253dba5-f94a-4d96-8a6c-e35ff352ce82'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '91d02da4-4e19-4718-bf63-2cfc388dfc21', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVYcikyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a44f26ed-88ff-486e-929f-141e51009aad', 'attached_at': '', 'detached_at': '', 'volume_id': '106e4496-4dc4-46fb-92b9-9d944c424427', 'serial': '106e4496-4dc4-46fb-92b9-9d944c424427'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '964c3625-cf80-4843-9644-86a35dcaf9dd', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:17:54 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:54 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBfdiAJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:17:54 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:17:54 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:17:54 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccb65a7-2eab-4c6c-9a59-fccd494ad41b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:17:54 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d3595a-476f-4838-a258-6bcebb9a7571]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b] added
Nov 15 14:17:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5bbc7e-2042-4bd9-add1-b3f7fb5aff7a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a55b17-742d-4f3a-b523-461be5a70ec8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBfdiAJw {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oBfdiAJw" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c7d30a-5b34-40cc-a8f1-9640ae0a86d9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oBfdiAJw'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[574c62a4-a391-4730-981d-a3cfca376eb8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab5111-4946-4c6e-8f13-af2ff15ecd2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e9485f-c965-4990-929b-16950423e0dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b, portal: 172.16.0.220,3260]
Nov 15 14:17:54 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b, portal: 172.16.0.220,3260] successful.
Nov 15 14:17:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d92d81-a4d8-473a-88d9-03d47137e543]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f0f5ab-6d2a-488f-abaa-a052e75a1f48]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:54 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:54 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6105ee88-e984-4170-8a84-28bbf2f0bab9]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:17:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBfdiAJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23437626332663331', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437626332663331', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyZFctih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:17:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:17:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:17:55 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aedeee-10fe-456a-a4fa-5c3679871427]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:17:55 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed99e04a-80f6-4678-a38b-dbebd4cd5e24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82] added
Nov 15 14:17:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7488291d-b20d-4add-8755-60c56a0b7f63]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3668caa4-53cf-4cdd-80da-039fe8a1f103]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyZFctih {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qyZFctih" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b69444-4026-470b-b7e0-0dd5d795ac68]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qyZFctih'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fda9a4-ab3c-4246-856a-01d7c5a2faef]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[74475691-6804-4f3f-944c-07ba60fd83d5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:55 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:55 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a0d9f2-0d92-48cb-8c77-52ab3b642297]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82, portal: 172.16.0.220,3260]
Nov 15 14:17:55 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82, portal: 172.16.0.220,3260] successful.
Nov 15 14:17:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c646f40a-9540-4a00-a901-5a83fed4110c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb14190-4ca9-42a7-91b8-69b2be5b7091]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:55 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:55 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:17:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:55 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:55 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:17:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a954c6f-62ac-4320-ae55-a03923fcc741]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-a6427b59-783e-496a-a627-87cad3aa889f req-0b4f4f92-d15a-43cf-ba41-94b8c6747b93 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a6427b59-783e-496a-a627-87cad3aa889f req-0b4f4f92-d15a-43cf-ba41-94b8c6747b93 service nova] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a6427b59-783e-496a-a627-87cad3aa889f req-0b4f4f92-d15a-43cf-ba41-94b8c6747b93 service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a6427b59-783e-496a-a627-87cad3aa889f req-0b4f4f92-d15a-43cf-ba41-94b8c6747b93 service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-a6427b59-783e-496a-a627-87cad3aa889f req-0b4f4f92-d15a-43cf-ba41-94b8c6747b93 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] No waiting events found dispatching network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:56 user nova-compute[74892]: WARNING nova.compute.manager [req-a6427b59-783e-496a-a627-87cad3aa889f req-0b4f4f92-d15a-43cf-ba41-94b8c6747b93 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received unexpected event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 for instance with vm_state active and task_state None.
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyZFctih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23832323832633239', 'path': '/dev/sdd'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832323832633239', 'path': '/dev/sdd'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVYcikyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:17:56 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:17:56 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:17:56 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da3202e-2551-4747-ab55-0424e92057c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:17:56 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a57b1e-429a-467a-9cf3-fb75f002b437]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427] added
Nov 15 14:17:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9b7853-ddce-447d-955e-e2cb04ad1a97]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1917253a-588b-4387-9db6-7af2e5759e3d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVYcikyT {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVYcikyT" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9b4c89-7530-472b-ac61-b556a75e12a8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aVYcikyT'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac2bdde-aa66-4744-a5aa-ed079848907a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15905b0-da82-433b-9278-aa578f3d123c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:17:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:17:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[85569ab7-4b3d-4b6c-be87-adae772ae401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427, portal: 172.16.0.220,3260]
Nov 15 14:17:57 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427, portal: 172.16.0.220,3260] successful.
Nov 15 14:17:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b582a3ea-a2ae-48d7-92a1-1e765c6ef0cf]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ef6b05-2336-45f9-831d-dec741a940c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:17:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:17:57 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:17:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e451bb30-cdd2-40ea-858d-822adc550233]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:17:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVYcikyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23464633636636564', 'path': '/dev/sde'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464633636636564', 'path': '/dev/sde'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=c1621ad1-87e8-436b-830e-a48822c95049,network=Network(31dd564a-91a8-4d2e-87a3-12b09f3aa0ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1621ad1-87') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:06:2f,bridge_name='br-int',has_traffic_filtering=True,id=67540ebd-51b4-4a04-9900-3c0d1e8d4364,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67540ebd-51') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:3f:43,bridge_name='br-int',has_traffic_filtering=True,id=5bdbd29b-ae5f-41f5-880a-947f3cd55259,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdbd29b-ae') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e9:72,bridge_name='br-int',has_traffic_filtering=True,id=6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1b4b99-7b') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbaf3e2-21') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:e2,bridge_name='br-int',has_traffic_filtering=True,id=67d418cb-b295-4fe3-857d-fa7eb1244168,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d418cb-b2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:43:7c,bridge_name='br-int',has_traffic_filtering=True,id=fa49ca22-dd97-4732-9e2d-b579298c6f58,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa49ca22-dd') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.objects.instance [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lazy-loading 'pci_devices' on Instance uuid a44f26ed-88ff-486e-929f-141e51009aad {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:17:58 user nova-compute[74892]:   <uuid>a44f26ed-88ff-486e-929f-141e51009aad</uuid>
Nov 15 14:17:58 user nova-compute[74892]:   <name>instance-0000000c</name>
Nov 15 14:17:58 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:17:58 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:17:58 user nova-compute[74892]:   <metadata>
Nov 15 14:17:58 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:17:58 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:17:58 user nova-compute[74892]:       <nova:name>tempest-device-tagging-server-1809967087</nova:name>
Nov 15 14:17:58 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:17:54</nova:creationTime>
Nov 15 14:17:58 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:17:58 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:17:58 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:17:58 user nova-compute[74892]:       <nova:owner>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:user uuid="33c01685d0044a389ad69dcdf99737e9">tempest-TaggedBootDevicesTest_v242-512234093-project-member</nova:user>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:project uuid="532a7e7ab572451690b43490840b3a78">tempest-TaggedBootDevicesTest_v242-512234093</nova:project>
Nov 15 14:17:58 user nova-compute[74892]:       </nova:owner>
Nov 15 14:17:58 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:17:58 user nova-compute[74892]:       <nova:ports>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:port uuid="c1621ad1-87e8-436b-830e-a48822c95049">
Nov 15 14:17:58 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:17:58 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:port uuid="67540ebd-51b4-4a04-9900-3c0d1e8d4364">
Nov 15 14:17:58 user nova-compute[74892]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
Nov 15 14:17:58 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:port uuid="5bdbd29b-ae5f-41f5-880a-947f3cd55259">
Nov 15 14:17:58 user nova-compute[74892]:           <nova:ip type="fixed" address="10.1.1.28" ipVersion="4"/>
Nov 15 14:17:58 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:port uuid="6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8">
Nov 15 14:17:58 user nova-compute[74892]:           <nova:ip type="fixed" address="10.1.1.3" ipVersion="4"/>
Nov 15 14:17:58 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:port uuid="acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3">
Nov 15 14:17:58 user nova-compute[74892]:           <nova:ip type="fixed" address="10.1.1.187" ipVersion="4"/>
Nov 15 14:17:58 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:port uuid="67d418cb-b295-4fe3-857d-fa7eb1244168">
Nov 15 14:17:58 user nova-compute[74892]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 14:17:58 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:58 user nova-compute[74892]:         <nova:port uuid="fa49ca22-dd97-4732-9e2d-b579298c6f58">
Nov 15 14:17:58 user nova-compute[74892]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 14:17:58 user nova-compute[74892]:         </nova:port>
Nov 15 14:17:58 user nova-compute[74892]:       </nova:ports>
Nov 15 14:17:58 user nova-compute[74892]:     </nova:instance>
Nov 15 14:17:58 user nova-compute[74892]:   </metadata>
Nov 15 14:17:58 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:17:58 user nova-compute[74892]:     <system>
Nov 15 14:17:58 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:17:58 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:17:58 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:17:58 user nova-compute[74892]:       <entry name="serial">a44f26ed-88ff-486e-929f-141e51009aad</entry>
Nov 15 14:17:58 user nova-compute[74892]:       <entry name="uuid">a44f26ed-88ff-486e-929f-141e51009aad</entry>
Nov 15 14:17:58 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:17:58 user nova-compute[74892]:     </system>
Nov 15 14:17:58 user nova-compute[74892]:   </sysinfo>
Nov 15 14:17:58 user nova-compute[74892]:   <os>
Nov 15 14:17:58 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:17:58 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:17:58 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:17:58 user nova-compute[74892]:   </os>
Nov 15 14:17:58 user nova-compute[74892]:   <features>
Nov 15 14:17:58 user nova-compute[74892]:     <acpi/>
Nov 15 14:17:58 user nova-compute[74892]:     <apic/>
Nov 15 14:17:58 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:17:58 user nova-compute[74892]:   </features>
Nov 15 14:17:58 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:17:58 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:17:58 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:17:58 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:17:58 user nova-compute[74892]:   </clock>
Nov 15 14:17:58 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:17:58 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:17:58 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:17:58 user nova-compute[74892]:   </cpu>
Nov 15 14:17:58 user nova-compute[74892]:   <devices>
Nov 15 14:17:58 user nova-compute[74892]:     <disk type="file" device="cdrom">
Nov 15 14:17:58 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 14:17:58 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/a44f26ed-88ff-486e-929f-141e51009aad/disk.config"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="hda" bus="ide"/>
Nov 15 14:17:58 user nova-compute[74892]:     </disk>
Nov 15 14:17:58 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:17:58 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:17:58 user nova-compute[74892]:       <source dev="/dev/sdc"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <serial>8aa31c72-2591-421d-81a8-6b3978425f8b</serial>
Nov 15 14:17:58 user nova-compute[74892]:     </disk>
Nov 15 14:17:58 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:17:58 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:17:58 user nova-compute[74892]:       <source dev="/dev/sdd"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <serial>2253dba5-f94a-4d96-8a6c-e35ff352ce82</serial>
Nov 15 14:17:58 user nova-compute[74892]:     </disk>
Nov 15 14:17:58 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:17:58 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:17:58 user nova-compute[74892]:       <source dev="/dev/sde"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="vdc" bus="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <serial>106e4496-4dc4-46fb-92b9-9d944c424427</serial>
Nov 15 14:17:58 user nova-compute[74892]:     </disk>
Nov 15 14:17:58 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:58 user nova-compute[74892]:       <mac address="fa:16:3e:33:3a:b3"/>
Nov 15 14:17:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="tapc1621ad1-87"/>
Nov 15 14:17:58 user nova-compute[74892]:     </interface>
Nov 15 14:17:58 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:58 user nova-compute[74892]:       <mac address="fa:16:3e:c3:06:2f"/>
Nov 15 14:17:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="tap67540ebd-51"/>
Nov 15 14:17:58 user nova-compute[74892]:     </interface>
Nov 15 14:17:58 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:58 user nova-compute[74892]:       <mac address="fa:16:3e:62:3f:43"/>
Nov 15 14:17:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="tap5bdbd29b-ae"/>
Nov 15 14:17:58 user nova-compute[74892]:     </interface>
Nov 15 14:17:58 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:58 user nova-compute[74892]:       <mac address="fa:16:3e:b2:e9:72"/>
Nov 15 14:17:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="tap6f1b4b99-7b"/>
Nov 15 14:17:58 user nova-compute[74892]:     </interface>
Nov 15 14:17:58 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:58 user nova-compute[74892]:       <mac address="fa:16:3e:13:fc:73"/>
Nov 15 14:17:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="tapacbaf3e2-21"/>
Nov 15 14:17:58 user nova-compute[74892]:     </interface>
Nov 15 14:17:58 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:58 user nova-compute[74892]:       <mac address="fa:16:3e:07:b0:e2"/>
Nov 15 14:17:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="tap67d418cb-b2"/>
Nov 15 14:17:58 user nova-compute[74892]:     </interface>
Nov 15 14:17:58 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:17:58 user nova-compute[74892]:       <mac address="fa:16:3e:9a:43:7c"/>
Nov 15 14:17:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:17:58 user nova-compute[74892]:       <target dev="tapfa49ca22-dd"/>
Nov 15 14:17:58 user nova-compute[74892]:     </interface>
Nov 15 14:17:58 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:17:58 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/a44f26ed-88ff-486e-929f-141e51009aad/console.log" append="off"/>
Nov 15 14:17:58 user nova-compute[74892]:     </serial>
Nov 15 14:17:58 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:17:58 user nova-compute[74892]:     <video>
Nov 15 14:17:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:17:58 user nova-compute[74892]:     </video>
Nov 15 14:17:58 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:17:58 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:17:58 user nova-compute[74892]:     </rng>
Nov 15 14:17:58 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:17:58 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:17:58 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:17:58 user nova-compute[74892]:     </memballoon>
Nov 15 14:17:58 user nova-compute[74892]:   </devices>
Nov 15 14:17:58 user nova-compute[74892]: </domain>
Nov 15 14:17:58 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=c1621ad1-87e8-436b-830e-a48822c95049,network=Network(31dd564a-91a8-4d2e-87a3-12b09f3aa0ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1621ad1-87') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=c1621ad1-87e8-436b-830e-a48822c95049,network=Network(31dd564a-91a8-4d2e-87a3-12b09f3aa0ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1621ad1-87') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ddbdee2-25ad-5547-9943-821232ffbce9', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1621ad1-87, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc1621ad1-87, col_values=(('qos', UUID('05f76865-d8e4-42a6-9a0f-53fa710de048')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc1621ad1-87, col_values=(('external_ids', {'iface-id': 'c1621ad1-87e8-436b-830e-a48822c95049', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:3a:b3', 'vm-uuid': 'a44f26ed-88ff-486e-929f-141e51009aad'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: INFO os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=c1621ad1-87e8-436b-830e-a48822c95049,network=Network(31dd564a-91a8-4d2e-87a3-12b09f3aa0ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1621ad1-87')
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:06:2f,bridge_name='br-int',has_traffic_filtering=True,id=67540ebd-51b4-4a04-9900-3c0d1e8d4364,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67540ebd-51') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:06:2f,bridge_name='br-int',has_traffic_filtering=True,id=67540ebd-51b4-4a04-9900-3c0d1e8d4364,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67540ebd-51') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd43318f8-5514-5c4d-a4cf-978dedf64184', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67540ebd-51, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67540ebd-51, col_values=(('qos', UUID('72cf5650-04f1-454e-8990-fa4400c0461e')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67540ebd-51, col_values=(('external_ids', {'iface-id': '67540ebd-51b4-4a04-9900-3c0d1e8d4364', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:06:2f', 'vm-uuid': 'a44f26ed-88ff-486e-929f-141e51009aad'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: INFO os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:06:2f,bridge_name='br-int',has_traffic_filtering=True,id=67540ebd-51b4-4a04-9900-3c0d1e8d4364,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67540ebd-51')
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:3f:43,bridge_name='br-int',has_traffic_filtering=True,id=5bdbd29b-ae5f-41f5-880a-947f3cd55259,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdbd29b-ae') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:3f:43,bridge_name='br-int',has_traffic_filtering=True,id=5bdbd29b-ae5f-41f5-880a-947f3cd55259,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdbd29b-ae') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80f6c6f0-280d-5bca-9f38-8855831e846e', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bdbd29b-ae, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bdbd29b-ae, col_values=(('qos', UUID('33b8297d-090d-40d9-a016-8f6d5dd12d3f')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bdbd29b-ae, col_values=(('external_ids', {'iface-id': '5bdbd29b-ae5f-41f5-880a-947f3cd55259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:3f:43', 'vm-uuid': 'a44f26ed-88ff-486e-929f-141e51009aad'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: INFO os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:3f:43,bridge_name='br-int',has_traffic_filtering=True,id=5bdbd29b-ae5f-41f5-880a-947f3cd55259,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdbd29b-ae')
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e9:72,bridge_name='br-int',has_traffic_filtering=True,id=6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1b4b99-7b') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e9:72,bridge_name='br-int',has_traffic_filtering=True,id=6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1b4b99-7b') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06e6a370-5c52-54a4-92ef-8bbeea29ca9d', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f1b4b99-7b, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f1b4b99-7b, col_values=(('qos', UUID('7793d68d-4af0-417b-bf1f-3c27efcdcc5a')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f1b4b99-7b, col_values=(('external_ids', {'iface-id': '6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:e9:72', 'vm-uuid': 'a44f26ed-88ff-486e-929f-141e51009aad'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: INFO os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e9:72,bridge_name='br-int',has_traffic_filtering=True,id=6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1b4b99-7b')
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbaf3e2-21') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbaf3e2-21') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27bef95b-81f0-5dd6-a727-b01847f4bc34', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacbaf3e2-21, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacbaf3e2-21, col_values=(('qos', UUID('8b818ffc-865d-43ee-b776-5ccec8bb8da8')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacbaf3e2-21, col_values=(('external_ids', {'iface-id': 'acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:fc:73', 'vm-uuid': 'a44f26ed-88ff-486e-929f-141e51009aad'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: INFO os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbaf3e2-21')
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:e2,bridge_name='br-int',has_traffic_filtering=True,id=67d418cb-b295-4fe3-857d-fa7eb1244168,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d418cb-b2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:e2,bridge_name='br-int',has_traffic_filtering=True,id=67d418cb-b295-4fe3-857d-fa7eb1244168,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d418cb-b2') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b33acc3-0252-58d7-b6c7-36ade232deb6', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67d418cb-b2, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67d418cb-b2, col_values=(('qos', UUID('c2efe3a6-d28d-4f0b-ba2f-eb2ab7f4b3bf')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67d418cb-b2, col_values=(('external_ids', {'iface-id': '67d418cb-b295-4fe3-857d-fa7eb1244168', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:b0:e2', 'vm-uuid': 'a44f26ed-88ff-486e-929f-141e51009aad'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: INFO os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:e2,bridge_name='br-int',has_traffic_filtering=True,id=67d418cb-b295-4fe3-857d-fa7eb1244168,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d418cb-b2')
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:17:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:43:7c,bridge_name='br-int',has_traffic_filtering=True,id=fa49ca22-dd97-4732-9e2d-b579298c6f58,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa49ca22-dd') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:43:7c,bridge_name='br-int',has_traffic_filtering=True,id=fa49ca22-dd97-4732-9e2d-b579298c6f58,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa49ca22-dd') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4309df3-0486-5bd9-b1f8-4bc38c52ea9c', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] No waiting events found dispatching network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:58 user nova-compute[74892]: WARNING nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received unexpected event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 for instance with vm_state active and task_state None.
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] No waiting events found dispatching network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:58 user nova-compute[74892]: WARNING nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received unexpected event network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 for instance with vm_state active and task_state None.
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] No waiting events found dispatching network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:58 user nova-compute[74892]: WARNING nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received unexpected event network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 for instance with vm_state active and task_state None.
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received event network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] No waiting events found dispatching network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:58 user nova-compute[74892]: WARNING nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received unexpected event network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f for instance with vm_state active and task_state None.
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received event network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] No waiting events found dispatching network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:58 user nova-compute[74892]: WARNING nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received unexpected event network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f for instance with vm_state active and task_state None.
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received event network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] No waiting events found dispatching network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:58 user nova-compute[74892]: WARNING nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received unexpected event network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae for instance with vm_state active and task_state None.
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received event network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] No waiting events found dispatching network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:17:58 user nova-compute[74892]: WARNING nova.compute.manager [req-6464c2fd-a147-4ea1-81e6-32ae6e2db677 req-5c8b512e-e51e-4555-95ff-edf6f3f35b91 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received unexpected event network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae for instance with vm_state active and task_state None.
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa49ca22-dd, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa49ca22-dd, col_values=(('qos', UUID('8035ff97-f47a-424c-b1c6-1ffd310b24c5')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa49ca22-dd, col_values=(('external_ids', {'iface-id': 'fa49ca22-dd97-4732-9e2d-b579298c6f58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:43:7c', 'vm-uuid': 'a44f26ed-88ff-486e-929f-141e51009aad'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:17:58 user nova-compute[74892]: INFO os_vif [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:43:7c,bridge_name='br-int',has_traffic_filtering=True,id=fa49ca22-dd97-4732-9e2d-b579298c6f58,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa49ca22-dd')
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] No BDM found with device name hda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] No VIF found with MAC fa:16:3e:33:3a:b3, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] No VIF found with MAC fa:16:3e:13:fc:73, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:17:58 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Using config drive
Nov 15 14:17:59 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Creating config drive at /opt/stack/data/nova/instances/a44f26ed-88ff-486e-929f-141e51009aad/disk.config
Nov 15 14:17:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a44f26ed-88ff-486e-929f-141e51009aad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3v9oh_07 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:17:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a44f26ed-88ff-486e-929f-141e51009aad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3v9oh_07" returned: 0 in 0.071s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-554c66cb-5779-4d87-8d56-8c73fe4683ac req-0de79c06-139f-4223-b3da-704c3d14a06a service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-554c66cb-5779-4d87-8d56-8c73fe4683ac req-0de79c06-139f-4223-b3da-704c3d14a06a service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-554c66cb-5779-4d87-8d56-8c73fe4683ac req-0de79c06-139f-4223-b3da-704c3d14a06a service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-554c66cb-5779-4d87-8d56-8c73fe4683ac req-0de79c06-139f-4223-b3da-704c3d14a06a service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-554c66cb-5779-4d87-8d56-8c73fe4683ac req-0de79c06-139f-4223-b3da-704c3d14a06a service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:01 user nova-compute[74892]: WARNING nova.compute.manager [req-554c66cb-5779-4d87-8d56-8c73fe4683ac req-0de79c06-139f-4223-b3da-704c3d14a06a service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 for instance with vm_state building and task_state spawning.
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-33ebc789-f0d0-4023-9ad1-48a8c8951845 req-d6b8c721-5484-44d7-bfac-ce52a1e4daeb service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33ebc789-f0d0-4023-9ad1-48a8c8951845 req-d6b8c721-5484-44d7-bfac-ce52a1e4daeb service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33ebc789-f0d0-4023-9ad1-48a8c8951845 req-d6b8c721-5484-44d7-bfac-ce52a1e4daeb service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33ebc789-f0d0-4023-9ad1-48a8c8951845 req-d6b8c721-5484-44d7-bfac-ce52a1e4daeb service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-33ebc789-f0d0-4023-9ad1-48a8c8951845 req-d6b8c721-5484-44d7-bfac-ce52a1e4daeb service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:01 user nova-compute[74892]: WARNING nova.compute.manager [req-33ebc789-f0d0-4023-9ad1-48a8c8951845 req-d6b8c721-5484-44d7-bfac-ce52a1e4daeb service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 for instance with vm_state building and task_state spawning.
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-db81a5dc-ac98-49a3-a7b9-15b8beb64d60 req-b9888e79-96fe-486d-8815-37e4526d9479 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-db81a5dc-ac98-49a3-a7b9-15b8beb64d60 req-b9888e79-96fe-486d-8815-37e4526d9479 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-db81a5dc-ac98-49a3-a7b9-15b8beb64d60 req-b9888e79-96fe-486d-8815-37e4526d9479 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-db81a5dc-ac98-49a3-a7b9-15b8beb64d60 req-b9888e79-96fe-486d-8815-37e4526d9479 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-db81a5dc-ac98-49a3-a7b9-15b8beb64d60 req-b9888e79-96fe-486d-8815-37e4526d9479 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:01 user nova-compute[74892]: WARNING nova.compute.manager [req-db81a5dc-ac98-49a3-a7b9-15b8beb64d60 req-b9888e79-96fe-486d-8815-37e4526d9479 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 for instance with vm_state building and task_state spawning.
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:03 user nova-compute[74892]: WARNING nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 for instance with vm_state building and task_state spawning.
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:03 user nova-compute[74892]: WARNING nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 for instance with vm_state building and task_state spawning.
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:03 user nova-compute[74892]: WARNING nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 for instance with vm_state building and task_state spawning.
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:03 user nova-compute[74892]: WARNING nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 for instance with vm_state building and task_state spawning.
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:03 user nova-compute[74892]: WARNING nova.compute.manager [req-e194b321-616e-4e0a-b99e-6416bc13c636 req-52ffc2d3-6e8b-4b75-80e4-d85d7d3108dd service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 for instance with vm_state building and task_state spawning.
Nov 15 14:18:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-996992e0-d579-4c90-bc3d-d46de1aec4b9 req-ea7e802d-9bf8-4abb-959d-31ae9dfb8055 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-996992e0-d579-4c90-bc3d-d46de1aec4b9 req-ea7e802d-9bf8-4abb-959d-31ae9dfb8055 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-996992e0-d579-4c90-bc3d-d46de1aec4b9 req-ea7e802d-9bf8-4abb-959d-31ae9dfb8055 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-996992e0-d579-4c90-bc3d-d46de1aec4b9 req-ea7e802d-9bf8-4abb-959d-31ae9dfb8055 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-996992e0-d579-4c90-bc3d-d46de1aec4b9 req-ea7e802d-9bf8-4abb-959d-31ae9dfb8055 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:03 user nova-compute[74892]: WARNING nova.compute.manager [req-996992e0-d579-4c90-bc3d-d46de1aec4b9 req-ea7e802d-9bf8-4abb-959d-31ae9dfb8055 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 for instance with vm_state building and task_state spawning.
Nov 15 14:18:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:04 user nova-compute[74892]: WARNING nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 for instance with vm_state building and task_state spawning.
Nov 15 14:18:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:04 user nova-compute[74892]: WARNING nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 for instance with vm_state building and task_state spawning.
Nov 15 14:18:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:04 user nova-compute[74892]: WARNING nova.compute.manager [req-4fc81e1d-ea51-4c3e-803f-b8538063708c req-9e5beb96-2686-4609-9dd1-ffe5812a7722 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 for instance with vm_state building and task_state spawning.
Nov 15 14:18:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:18:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance spawned successfully.
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:05 user nova-compute[74892]: WARNING nova.compute.manager [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 for instance with vm_state building and task_state spawning.
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:05 user nova-compute[74892]: WARNING nova.compute.manager [req-1db92d4c-0328-472a-abc0-0ac870270e57 req-b3f89b2d-089d-44e4-8a34-c4e51b5ebb71 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 for instance with vm_state building and task_state spawning.
Nov 15 14:18:05 user nova-compute[74892]: INFO nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Took 11.12 seconds to spawn the instance on the hypervisor.
Nov 15 14:18:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:18:05 user nova-compute[74892]: INFO nova.compute.manager [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Took 30.53 seconds to build instance.
Nov 15 14:18:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f7138f2d-5883-4d69-ac64-f2747a3e0d33 tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "a44f26ed-88ff-486e-929f-141e51009aad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.746s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:18:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:18:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:18:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:18:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:18:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:18:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:18:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:18:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:18:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:18:31 user nova-compute[74892]: INFO nova.compute.manager [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] instance snapshotting
Nov 15 14:18:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Beginning live snapshot process
Nov 15 14:18:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json -f qcow2 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json -f qcow2 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqmt51sw8/34259c0d0bb34ad0b1db75677f4fed99.delta 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqmt51sw8/34259c0d0bb34ad0b1db75677f4fed99.delta 1073741824" returned: 0 in 0.050s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 14:18:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74892) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 14:18:32 user nova-compute[74892]: INFO nova.virt.libvirt.host [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] UEFI support detected
Nov 15 14:18:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:18:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:18:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 14:18:34 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:18:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqmt51sw8/34259c0d0bb34ad0b1db75677f4fed99.delta /opt/stack/data/nova/instances/snapshots/tmpqmt51sw8/34259c0d0bb34ad0b1db75677f4fed99 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqmt51sw8/34259c0d0bb34ad0b1db75677f4fed99.delta /opt/stack/data/nova/instances/snapshots/tmpqmt51sw8/34259c0d0bb34ad0b1db75677f4fed99" returned: 0 in 0.492s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Snapshot extracted, beginning image upload
Nov 15 14:18:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:18:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:18:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:18:36 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:37 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Snapshot image upload complete
Nov 15 14:18:37 user nova-compute[74892]: INFO nova.compute.manager [None req-35b1b6e6-6dab-4c76-8fe4-d869c07a36a9 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Took 5.26 seconds to snapshot the instance on the hypervisor.
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:41 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:18:41 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=6586MB free_disk=25.384387969970703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a038db7d-023b-44ac-a74e-be018b0b6492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e03890e3-60d4-4719-a2db-7cc1fe245b11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c155e78a-3bb5-46b1-ac34-0bace9450318 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance f95b420a-69c7-44c0-aba8-0462c1598841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 92b19e94-da7c-4d74-a89a-ea5c709e573c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a44f26ed-88ff-486e-929f-141e51009aad actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:18:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:18:42 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:18:42 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:18:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:18:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-0b15d07c-a7cf-4bf4-a42a-227f75c6675f req-29d7429c-2734-4967-bc2a-dc3e9f37bb38 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-changed-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-0b15d07c-a7cf-4bf4-a42a-227f75c6675f req-29d7429c-2734-4967-bc2a-dc3e9f37bb38 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Refreshing instance network info cache due to event network-changed-4426f0fd-a229-4b73-a68e-6b9456304d1c. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0b15d07c-a7cf-4bf4-a42a-227f75c6675f req-29d7429c-2734-4967-bc2a-dc3e9f37bb38 service nova] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0b15d07c-a7cf-4bf4-a42a-227f75c6675f req-29d7429c-2734-4967-bc2a-dc3e9f37bb38 service nova] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:18:43 user nova-compute[74892]: DEBUG nova.network.neutron [req-0b15d07c-a7cf-4bf4-a42a-227f75c6675f req-29d7429c-2734-4967-bc2a-dc3e9f37bb38 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Refreshing network info cache for port 4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:18:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-0b15d07c-a7cf-4bf4-a42a-227f75c6675f req-29d7429c-2734-4967-bc2a-dc3e9f37bb38 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updated VIF entry in instance network info cache for port 4426f0fd-a229-4b73-a68e-6b9456304d1c. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:18:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-0b15d07c-a7cf-4bf4-a42a-227f75c6675f req-29d7429c-2734-4967-bc2a-dc3e9f37bb38 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:18:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0b15d07c-a7cf-4bf4-a42a-227f75c6675f req-29d7429c-2734-4967-bc2a-dc3e9f37bb38 service nova] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:18:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-e0cb2e37-c250-4b6e-87aa-77208f5d5fba req-c0b7d71f-980e-48f1-8dea-884c62e929cd service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-changed-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-e0cb2e37-c250-4b6e-87aa-77208f5d5fba req-c0b7d71f-980e-48f1-8dea-884c62e929cd service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Refreshing instance network info cache due to event network-changed-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:18:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e0cb2e37-c250-4b6e-87aa-77208f5d5fba req-c0b7d71f-980e-48f1-8dea-884c62e929cd service nova] Acquiring lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:18:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e0cb2e37-c250-4b6e-87aa-77208f5d5fba req-c0b7d71f-980e-48f1-8dea-884c62e929cd service nova] Acquired lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:18:45 user nova-compute[74892]: DEBUG nova.network.neutron [req-e0cb2e37-c250-4b6e-87aa-77208f5d5fba req-c0b7d71f-980e-48f1-8dea-884c62e929cd service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Refreshing network info cache for port c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:18:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:46 user nova-compute[74892]: DEBUG nova.network.neutron [req-e0cb2e37-c250-4b6e-87aa-77208f5d5fba req-c0b7d71f-980e-48f1-8dea-884c62e929cd service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updated VIF entry in instance network info cache for port c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:18:46 user nova-compute[74892]: DEBUG nova.network.neutron [req-e0cb2e37-c250-4b6e-87aa-77208f5d5fba req-c0b7d71f-980e-48f1-8dea-884c62e929cd service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updating instance_info_cache with network_info: [{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:18:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e0cb2e37-c250-4b6e-87aa-77208f5d5fba req-c0b7d71f-980e-48f1-8dea-884c62e929cd service nova] Releasing lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-cb613091-18a3-40dc-9b6e-1a455818ba7a req-8206b79a-2fcd-469d-8a79-eac2ab2e0b37 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-changed-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-cb613091-18a3-40dc-9b6e-1a455818ba7a req-8206b79a-2fcd-469d-8a79-eac2ab2e0b37 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Refreshing instance network info cache due to event network-changed-571e109b-b616-4b07-84af-97aac4371356. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cb613091-18a3-40dc-9b6e-1a455818ba7a req-8206b79a-2fcd-469d-8a79-eac2ab2e0b37 service nova] Acquiring lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cb613091-18a3-40dc-9b6e-1a455818ba7a req-8206b79a-2fcd-469d-8a79-eac2ab2e0b37 service nova] Acquired lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG nova.network.neutron [req-cb613091-18a3-40dc-9b6e-1a455818ba7a req-8206b79a-2fcd-469d-8a79-eac2ab2e0b37 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Refreshing network info cache for port 571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG nova.network.neutron [req-cb613091-18a3-40dc-9b6e-1a455818ba7a req-8206b79a-2fcd-469d-8a79-eac2ab2e0b37 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updated VIF entry in instance network info cache for port 571e109b-b616-4b07-84af-97aac4371356. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG nova.network.neutron [req-cb613091-18a3-40dc-9b6e-1a455818ba7a req-8206b79a-2fcd-469d-8a79-eac2ab2e0b37 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating instance_info_cache with network_info: [{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cb613091-18a3-40dc-9b6e-1a455818ba7a req-8206b79a-2fcd-469d-8a79-eac2ab2e0b37 service nova] Releasing lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:18:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:49 user nova-compute[74892]: INFO nova.compute.manager [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Shelving
Nov 15 14:18:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-dd133f12-c1d0-4176-a2be-5637ad863d71 req-f8b9cb56-b2ba-46a9-a956-d06ce373483d service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-unplugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dd133f12-c1d0-4176-a2be-5637ad863d71 req-f8b9cb56-b2ba-46a9-a956-d06ce373483d service nova] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dd133f12-c1d0-4176-a2be-5637ad863d71 req-f8b9cb56-b2ba-46a9-a956-d06ce373483d service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dd133f12-c1d0-4176-a2be-5637ad863d71 req-f8b9cb56-b2ba-46a9-a956-d06ce373483d service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-dd133f12-c1d0-4176-a2be-5637ad863d71 req-f8b9cb56-b2ba-46a9-a956-d06ce373483d service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] No waiting events found dispatching network-vif-unplugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:49 user nova-compute[74892]: WARNING nova.compute.manager [req-dd133f12-c1d0-4176-a2be-5637ad863d71 req-f8b9cb56-b2ba-46a9-a956-d06ce373483d service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received unexpected event network-vif-unplugged-571e109b-b616-4b07-84af-97aac4371356 for instance with vm_state active and task_state shelving.
Nov 15 14:18:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance destroyed successfully.
Nov 15 14:18:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Beginning cold snapshot process
Nov 15 14:18:50 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:18:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk /opt/stack/data/nova/instances/snapshots/tmpp_lxvjwy/a4749437c23c4924865231c0e6a11c11 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk /opt/stack/data/nova/instances/snapshots/tmpp_lxvjwy/a4749437c23c4924865231c0e6a11c11" returned: 0 in 0.448s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Snapshot extracted, beginning image upload
Nov 15 14:18:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-8f0ce6b6-0ef1-4c6a-8b6e-0fb296364355 req-c82970b0-d4dc-4986-ba17-a0aad1e3ab5b service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8f0ce6b6-0ef1-4c6a-8b6e-0fb296364355 req-c82970b0-d4dc-4986-ba17-a0aad1e3ab5b service nova] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8f0ce6b6-0ef1-4c6a-8b6e-0fb296364355 req-c82970b0-d4dc-4986-ba17-a0aad1e3ab5b service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8f0ce6b6-0ef1-4c6a-8b6e-0fb296364355 req-c82970b0-d4dc-4986-ba17-a0aad1e3ab5b service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-8f0ce6b6-0ef1-4c6a-8b6e-0fb296364355 req-c82970b0-d4dc-4986-ba17-a0aad1e3ab5b service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] No waiting events found dispatching network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:18:52 user nova-compute[74892]: WARNING nova.compute.manager [req-8f0ce6b6-0ef1-4c6a-8b6e-0fb296364355 req-c82970b0-d4dc-4986-ba17-a0aad1e3ab5b service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received unexpected event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 14:18:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Snapshot image upload complete
Nov 15 14:18:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:18:53 user nova-compute[74892]: INFO nova.compute.manager [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Shelve offloading
Nov 15 14:18:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance destroyed successfully.
Nov 15 14:18:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:18:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:18:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquired lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:18:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:18:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating instance_info_cache with network_info: [{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Releasing lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:18:54 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance destroyed successfully.
Nov 15 14:18:54 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'resources' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1702806374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1702806374',id=4,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcKO71oeZrgy6wz9s/wPxza901ZFMNKyl2MUdIi82+6RHq4oQxD7hsBGsnSKky8SJzUR8AZKzc+Nx4KVU1pFWiG2B+khnBeJ7VgrHzCGzypwZl4fbObFWScYtHqED6u+w==',key_name='tempest-keypair-1680936907',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ryzg4t4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member',shelved_at='2023-11-15T14:18:53.619854',shelved_host='user',shelved_image_id='363aace8-2c2f-4e78-a444-1dfec4b36add'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=ffa60aac-02a4-42ab-b97b-b9cc56079e44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG os_vif [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap571e109b-b6, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-18e55472-14bf-4b6d-bd0f-48b2f4e7eef8 req-dc3d868f-2344-4e5e-9fdd-8b85505931d2 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-changed-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-18e55472-14bf-4b6d-bd0f-48b2f4e7eef8 req-dc3d868f-2344-4e5e-9fdd-8b85505931d2 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Refreshing instance network info cache due to event network-changed-571e109b-b616-4b07-84af-97aac4371356. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-18e55472-14bf-4b6d-bd0f-48b2f4e7eef8 req-dc3d868f-2344-4e5e-9fdd-8b85505931d2 service nova] Acquiring lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-18e55472-14bf-4b6d-bd0f-48b2f4e7eef8 req-dc3d868f-2344-4e5e-9fdd-8b85505931d2 service nova] Acquired lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-18e55472-14bf-4b6d-bd0f-48b2f4e7eef8 req-dc3d868f-2344-4e5e-9fdd-8b85505931d2 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Refreshing network info cache for port 571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=169d584b-319f-43e5-8da8-44c1adf5f117) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:18:55 user nova-compute[74892]: INFO os_vif [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6')
Nov 15 14:18:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Deleting instance files /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44_del
Nov 15 14:18:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Deletion of /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44_del complete
Nov 15 14:18:55 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Deleted allocations for instance ffa60aac-02a4-42ab-b97b-b9cc56079e44
Nov 15 14:18:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'numa_topology' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG nova.objects.base [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<ffa60aac-02a4-42ab-b97b-b9cc56079e44> lazy-loaded attributes: resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG nova.network.neutron [req-18e55472-14bf-4b6d-bd0f-48b2f4e7eef8 req-dc3d868f-2344-4e5e-9fdd-8b85505931d2 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updated VIF entry in instance network info cache for port 571e109b-b616-4b07-84af-97aac4371356. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG nova.network.neutron [req-18e55472-14bf-4b6d-bd0f-48b2f4e7eef8 req-dc3d868f-2344-4e5e-9fdd-8b85505931d2 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating instance_info_cache with network_info: [{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap571e109b-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-18e55472-14bf-4b6d-bd0f-48b2f4e7eef8 req-dc3d868f-2344-4e5e-9fdd-8b85505931d2 service nova] Releasing lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ac1c02b-ce91-4887-af1e-2990131bb8b5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.316s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-bc197e1c-6e4f-434d-97a8-c99f55581586 req-3ca285bf-0c9d-4fe8-9b05-3846f0794990 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received event network-changed-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-bc197e1c-6e4f-434d-97a8-c99f55581586 req-3ca285bf-0c9d-4fe8-9b05-3846f0794990 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Refreshing instance network info cache due to event network-changed-188d856a-8fff-4e87-ada8-31361f90d65f. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:18:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bc197e1c-6e4f-434d-97a8-c99f55581586 req-3ca285bf-0c9d-4fe8-9b05-3846f0794990 service nova] Acquiring lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:18:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bc197e1c-6e4f-434d-97a8-c99f55581586 req-3ca285bf-0c9d-4fe8-9b05-3846f0794990 service nova] Acquired lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:18:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-bc197e1c-6e4f-434d-97a8-c99f55581586 req-3ca285bf-0c9d-4fe8-9b05-3846f0794990 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Refreshing network info cache for port 188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:18:58 user nova-compute[74892]: DEBUG nova.network.neutron [req-bc197e1c-6e4f-434d-97a8-c99f55581586 req-3ca285bf-0c9d-4fe8-9b05-3846f0794990 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updated VIF entry in instance network info cache for port 188d856a-8fff-4e87-ada8-31361f90d65f. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:18:58 user nova-compute[74892]: DEBUG nova.network.neutron [req-bc197e1c-6e4f-434d-97a8-c99f55581586 req-3ca285bf-0c9d-4fe8-9b05-3846f0794990 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updating instance_info_cache with network_info: [{"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:18:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bc197e1c-6e4f-434d-97a8-c99f55581586 req-3ca285bf-0c9d-4fe8-9b05-3846f0794990 service nova] Releasing lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG nova.objects.instance [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lazy-loading 'flavor' on Instance uuid a038db7d-023b-44ac-a74e-be018b0b6492 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-d7835ebf-9297-4db3-af91-0a73369dd6bb req-12b04157-c48d-4f62-962a-09136041b60a service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received event network-changed-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-d7835ebf-9297-4db3-af91-0a73369dd6bb req-12b04157-c48d-4f62-962a-09136041b60a service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Refreshing instance network info cache due to event network-changed-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d7835ebf-9297-4db3-af91-0a73369dd6bb req-12b04157-c48d-4f62-962a-09136041b60a service nova] Acquiring lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d7835ebf-9297-4db3-af91-0a73369dd6bb req-12b04157-c48d-4f62-962a-09136041b60a service nova] Acquired lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG nova.network.neutron [req-d7835ebf-9297-4db3-af91-0a73369dd6bb req-12b04157-c48d-4f62-962a-09136041b60a service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Refreshing network info cache for port 5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:59 user nova-compute[74892]: INFO nova.compute.manager [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Attaching volume db4d466c-1c3d-456e-a075-624d63b0252a to /dev/vdb
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG nova.objects.instance [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lazy-loading 'flavor' on Instance uuid 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG os_brick.utils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffea6a63-9fe4-4f50-947c-97d9ba52d8ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[59abb0af-8fcc-495b-9029-179c45a51842]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c47cb1e-9488-4b5e-b258-9a68c1c3dd2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ffff56-614c-46dc-803b-9341f490502a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:18:59 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a357d5-f6bc-43ce-b58a-b0985016ad94]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG os_brick.utils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updating existing volume attachment record: 3902c06e-a819-469b-a1b7-728e57c5996c {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG nova.network.neutron [req-d7835ebf-9297-4db3-af91-0a73369dd6bb req-12b04157-c48d-4f62-962a-09136041b60a service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Updated VIF entry in instance network info cache for port 5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG nova.network.neutron [req-d7835ebf-9297-4db3-af91-0a73369dd6bb req-12b04157-c48d-4f62-962a-09136041b60a service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Updating instance_info_cache with network_info: [{"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d7835ebf-9297-4db3-af91-0a73369dd6bb req-12b04157-c48d-4f62-962a-09136041b60a service nova] Releasing lock "refresh_cache-8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:18:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:18:59 user nova-compute[74892]: INFO nova.compute.manager [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Attaching volume 626065b0-844a-47be-b095-5a5f025014e8 to /dev/vdb
Nov 15 14:19:00 user nova-compute[74892]: DEBUG os_brick.utils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[915652f9-424a-4ace-b4e0-3ede363b2c88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc70ece-bac1-4c8f-a470-5197d6c88910]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a178ccc-f4be-48eb-a26b-86c406470765]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa904c2-e948-41cf-b3f8-2d324ae6419d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:00 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:19:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bad125-2c39-4bf8-85bd-1312d8aedd6c]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG os_brick.utils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:00 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Updating existing volume attachment record: 1cb57fac-a68f-4c05-a438-520aef7778bc {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-63b488c6-faff-4a18-8c68-0b109f4e851a req-64c7e4c9-9237-49bd-bb9f-29fa0a4bc741 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-changed-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-63b488c6-faff-4a18-8c68-0b109f4e851a req-64c7e4c9-9237-49bd-bb9f-29fa0a4bc741 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Refreshing instance network info cache due to event network-changed-1130e682-747f-499b-9d41-0ed33fd5e873. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-63b488c6-faff-4a18-8c68-0b109f4e851a req-64c7e4c9-9237-49bd-bb9f-29fa0a4bc741 service nova] Acquiring lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-63b488c6-faff-4a18-8c68-0b109f4e851a req-64c7e4c9-9237-49bd-bb9f-29fa0a4bc741 service nova] Acquired lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-63b488c6-faff-4a18-8c68-0b109f4e851a req-64c7e4c9-9237-49bd-bb9f-29fa0a4bc741 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Refreshing network info cache for port 1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-dedc1536-d801-4e83-8788-ab1c109ddc33 req-e305439e-893c-4887-9fae-d65808f2f8c4 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-changed-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-dedc1536-d801-4e83-8788-ab1c109ddc33 req-e305439e-893c-4887-9fae-d65808f2f8c4 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Refreshing instance network info cache due to event network-changed-4c90eb33-2bf7-404b-a08e-c268206cdd69. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dedc1536-d801-4e83-8788-ab1c109ddc33 req-e305439e-893c-4887-9fae-d65808f2f8c4 service nova] Acquiring lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dedc1536-d801-4e83-8788-ab1c109ddc33 req-e305439e-893c-4887-9fae-d65808f2f8c4 service nova] Acquired lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-dedc1536-d801-4e83-8788-ab1c109ddc33 req-e305439e-893c-4887-9fae-d65808f2f8c4 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Refreshing network info cache for port 4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-63b488c6-faff-4a18-8c68-0b109f4e851a req-64c7e4c9-9237-49bd-bb9f-29fa0a4bc741 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Updated VIF entry in instance network info cache for port 1130e682-747f-499b-9d41-0ed33fd5e873. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-63b488c6-faff-4a18-8c68-0b109f4e851a req-64c7e4c9-9237-49bd-bb9f-29fa0a4bc741 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Updating instance_info_cache with network_info: [{"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-63b488c6-faff-4a18-8c68-0b109f4e851a req-64c7e4c9-9237-49bd-bb9f-29fa0a4bc741 service nova] Releasing lock "refresh_cache-c155e78a-3bb5-46b1-ac34-0bace9450318" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "interface-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "interface-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.objects.instance [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lazy-loading 'flavor' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.objects.instance [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lazy-loading 'pci_requests' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.objects.base [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Object Instance<16c1e6b8-fe5d-4a42-b8cb-453b37c88b46> lazy-loaded attributes: flavor,pci_requests {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-dedc1536-d801-4e83-8788-ab1c109ddc33 req-e305439e-893c-4887-9fae-d65808f2f8c4 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updated VIF entry in instance network info cache for port 4c90eb33-2bf7-404b-a08e-c268206cdd69. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-dedc1536-d801-4e83-8788-ab1c109ddc33 req-e305439e-893c-4887-9fae-d65808f2f8c4 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dedc1536-d801-4e83-8788-ab1c109ddc33 req-e305439e-893c-4887-9fae-d65808f2f8c4 service nova] Releasing lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:02 user nova-compute[74892]: DEBUG nova.policy [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '096ca6cfce6b437f85f220646f97b902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '446202d935a749749fbba99be6a1d00c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:19:02 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Successfully created port: 8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Successfully updated port: 8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquired lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-fcbe5f00-6477-475e-926a-1a8ef08118c6 req-91207ca6-c503-4b48-9d6d-a3cf5476ebc6 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-changed-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-fcbe5f00-6477-475e-926a-1a8ef08118c6 req-91207ca6-c503-4b48-9d6d-a3cf5476ebc6 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Refreshing instance network info cache due to event network-changed-8c8e3c8d-0fec-4955-980b-4ab9ec27e072. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fcbe5f00-6477-475e-926a-1a8ef08118c6 req-91207ca6-c503-4b48-9d6d-a3cf5476ebc6 service nova] Acquiring lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Releasing lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fcbe5f00-6477-475e-926a-1a8ef08118c6 req-91207ca6-c503-4b48-9d6d-a3cf5476ebc6 service nova] Acquired lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-fcbe5f00-6477-475e-926a-1a8ef08118c6 req-91207ca6-c503-4b48-9d6d-a3cf5476ebc6 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Refreshing network info cache for port 8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converting VIF {"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG os_vif [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2cdd6a21-db33-5fcc-a67b-9bcbd09ebe3c', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c8e3c8d-0f, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c8e3c8d-0f, col_values=(('qos', UUID('942cdd98-e3a0-4458-8d05-50a19f779837')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c8e3c8d-0f, col_values=(('external_ids', {'iface-id': '8c8e3c8d-0fec-4955-980b-4ab9ec27e072', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:64:d0', 'vm-uuid': '16c1e6b8-fe5d-4a42-b8cb-453b37c88b46'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: INFO os_vif [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f')
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converting VIF {"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] attach device xml: <interface type="ethernet">
Nov 15 14:19:04 user nova-compute[74892]:   <mac address="fa:16:3e:74:64:d0"/>
Nov 15 14:19:04 user nova-compute[74892]:   <model type="virtio"/>
Nov 15 14:19:04 user nova-compute[74892]:   <mtu size="1442"/>
Nov 15 14:19:04 user nova-compute[74892]:   <target dev="tap8c8e3c8d-0f"/>
Nov 15 14:19:04 user nova-compute[74892]: </interface>
Nov 15 14:19:04 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-fe2cc7ae-ce6a-4e1d-b915-2c6a6d788164 req-8d5c651a-dc57-4934-97b2-72b27253ba53 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fe2cc7ae-ce6a-4e1d-b915-2c6a6d788164 req-8d5c651a-dc57-4934-97b2-72b27253ba53 service nova] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fe2cc7ae-ce6a-4e1d-b915-2c6a6d788164 req-8d5c651a-dc57-4934-97b2-72b27253ba53 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fe2cc7ae-ce6a-4e1d-b915-2c6a6d788164 req-8d5c651a-dc57-4934-97b2-72b27253ba53 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-fe2cc7ae-ce6a-4e1d-b915-2c6a6d788164 req-8d5c651a-dc57-4934-97b2-72b27253ba53 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] No waiting events found dispatching network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:04 user nova-compute[74892]: WARNING nova.compute.manager [req-fe2cc7ae-ce6a-4e1d-b915-2c6a6d788164 req-8d5c651a-dc57-4934-97b2-72b27253ba53 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received unexpected event network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 for instance with vm_state active and task_state None.
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No BDM found with device name hda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No VIF found with MAC fa:16:3e:ba:03:b4, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:04 user nova-compute[74892]:   <nova:package version="0.0.0"/>
Nov 15 14:19:04 user nova-compute[74892]:   <nova:name>tempest-device-tagging-server-1329550711</nova:name>
Nov 15 14:19:04 user nova-compute[74892]:   <nova:creationTime>2023-11-15 14:19:04</nova:creationTime>
Nov 15 14:19:04 user nova-compute[74892]:   <nova:flavor name="m1.tiny">
Nov 15 14:19:04 user nova-compute[74892]:     <nova:memory>512</nova:memory>
Nov 15 14:19:04 user nova-compute[74892]:     <nova:disk>1</nova:disk>
Nov 15 14:19:04 user nova-compute[74892]:     <nova:swap>0</nova:swap>
Nov 15 14:19:04 user nova-compute[74892]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:04 user nova-compute[74892]:     <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:04 user nova-compute[74892]:   </nova:flavor>
Nov 15 14:19:04 user nova-compute[74892]:   <nova:owner>
Nov 15 14:19:04 user nova-compute[74892]:     <nova:user uuid="096ca6cfce6b437f85f220646f97b902">tempest-TaggedAttachmentsTest-785094056-project-member</nova:user>
Nov 15 14:19:04 user nova-compute[74892]:     <nova:project uuid="446202d935a749749fbba99be6a1d00c">tempest-TaggedAttachmentsTest-785094056</nova:project>
Nov 15 14:19:04 user nova-compute[74892]:   </nova:owner>
Nov 15 14:19:04 user nova-compute[74892]:   <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:04 user nova-compute[74892]:   <nova:ports>
Nov 15 14:19:04 user nova-compute[74892]:     <nova:port uuid="4c90eb33-2bf7-404b-a08e-c268206cdd69">
Nov 15 14:19:04 user nova-compute[74892]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:19:04 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:04 user nova-compute[74892]:     <nova:port uuid="8c8e3c8d-0fec-4955-980b-4ab9ec27e072">
Nov 15 14:19:04 user nova-compute[74892]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Nov 15 14:19:04 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:04 user nova-compute[74892]:   </nova:ports>
Nov 15 14:19:04 user nova-compute[74892]: </nova:instance>
Nov 15 14:19:04 user nova-compute[74892]:  {{(pid=74892) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23fad6fb-429a-494c-be66-546922cde7d3 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "interface-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.932s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.network.neutron [req-fcbe5f00-6477-475e-926a-1a8ef08118c6 req-91207ca6-c503-4b48-9d6d-a3cf5476ebc6 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updated VIF entry in instance network info cache for port 8c8e3c8d-0fec-4955-980b-4ab9ec27e072. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.network.neutron [req-fcbe5f00-6477-475e-926a-1a8ef08118c6 req-91207ca6-c503-4b48-9d6d-a3cf5476ebc6 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fcbe5f00-6477-475e-926a-1a8ef08118c6 req-91207ca6-c503-4b48-9d6d-a3cf5476ebc6 service nova] Releasing lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlQPgwNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:04 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:04 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:04 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f938a587-fb73-458c-af35-1349c630576a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:04 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f24e0-ceb4-47c5-b920-54ed58abd796]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a] added
Nov 15 14:19:04 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[478af5dd-e8b3-4ea6-a34e-ed219a36b9ab]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bbe683-69c4-4faa-99f6-270126c3612c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "e03890e3-60d4-4719-a2db-7cc1fe245b11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:04 user nova-compute[74892]: INFO nova.compute.manager [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Terminating instance
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OlQPgwNV {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OlQPgwNV" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8c1fe4-5a9e-467e-9244-164ca5e48f43]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OlQPgwNV'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG nova.objects.instance [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lazy-loading 'flavor' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d618b0-6835-4d2c-9c15-5284ce58f49a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a5af61-4a7c-42cd-a911-1e76a2216e63]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:05 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:05 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[89719f1e-fa34-41ce-865a-cc5169fd8fef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a, portal: 172.16.0.220,3260]
Nov 15 14:19:05 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:05 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c6d003-b92a-4260-9c6d-8c2392b3a45f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b31e1c-9ca2-4d03-b401-d32798d480d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:05 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:05 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:05 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[414baa39-fb72-4f1a-92a2-460a251c406e]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlQPgwNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:05 user nova-compute[74892]: INFO nova.compute.manager [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Attaching volume f714f9d6-fcb7-4824-87d8-08b362c765dc to /dev/vdb
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.utils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:05 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f881d4e8-3a9e-44c1-a86c-3c25301b142f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d62ed7b-d300-4228-b0e8-37601a4f8acc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51b51b9-0cd7-4bcf-95af-68c5d1280591]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[20af1d89-ea45-4286-a8ea-ecabc1712188]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-9949b033-223c-4e9a-b41c-b072a2241155 req-59085b94-7aaf-499b-aae9-f30fe3824dc1 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received event network-vif-unplugged-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9949b033-223c-4e9a-b41c-b072a2241155 req-59085b94-7aaf-499b-aae9-f30fe3824dc1 service nova] Acquiring lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9949b033-223c-4e9a-b41c-b072a2241155 req-59085b94-7aaf-499b-aae9-f30fe3824dc1 service nova] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9949b033-223c-4e9a-b41c-b072a2241155 req-59085b94-7aaf-499b-aae9-f30fe3824dc1 service nova] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-9949b033-223c-4e9a-b41c-b072a2241155 req-59085b94-7aaf-499b-aae9-f30fe3824dc1 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] No waiting events found dispatching network-vif-unplugged-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-9949b033-223c-4e9a-b41c-b072a2241155 req-59085b94-7aaf-499b-aae9-f30fe3824dc1 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received event network-vif-unplugged-591e68d4-53a5-411c-b419-55b0b833abc5 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:05 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e47198d-271c-42be-9c62-db5835e36234]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_brick.utils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating existing volume attachment record: 1972dd9f-995b-43ca-affd-bed3e50af780 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:19:05 user nova-compute[74892]: INFO nova.compute.manager [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Rebuilding instance
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Instance destroyed successfully.
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lazy-loading 'resources' on Instance uuid e03890e3-60d4-4719-a2db-7cc1fe245b11 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1328408325',display_name='tempest-VolumesActionsTest-instance-1328408325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1328408325',id=8,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24aea1db854c42c0aa85018c5518b0a5',ramdisk_id='',reservation_id='r-0zsim08u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1307238287',owner_user_name='tempest-VolumesActionsTest-1307238287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:24Z,user_data=None,user_id='99f4ed77744d4cdb80cca826b6dc50b9',uuid=e03890e3-60d4-4719-a2db-7cc1fe245b11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converting VIF {"id": "591e68d4-53a5-411c-b419-55b0b833abc5", "address": "fa:16:3e:ac:fa:ba", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap591e68d4-53", "ovs_interfaceid": "591e68d4-53a5-411c-b419-55b0b833abc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:fa:ba,bridge_name='br-int',has_traffic_filtering=True,id=591e68d4-53a5-411c-b419-55b0b833abc5,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591e68d4-53') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG os_vif [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:fa:ba,bridge_name='br-int',has_traffic_filtering=True,id=591e68d4-53a5-411c-b419-55b0b833abc5,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591e68d4-53') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap591e68d4-53, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a97e87b-d412-419a-8035-fa88ce1ce518) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:05 user nova-compute[74892]: INFO os_vif [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:fa:ba,bridge_name='br-int',has_traffic_filtering=True,id=591e68d4-53a5-411c-b419-55b0b833abc5,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap591e68d4-53')
Nov 15 14:19:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Deleting instance files /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11_del
Nov 15 14:19:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Deletion of /opt/stack/data/nova/instances/e03890e3-60d4-4719-a2db-7cc1fe245b11_del complete
Nov 15 14:19:05 user nova-compute[74892]: INFO nova.compute.manager [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 14:19:05 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:19:05 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23630373463643835', 'path': '/dev/sdf'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630373463643835', 'path': '/dev/sdf'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.894s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:06 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:06 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.objects.instance [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lazy-loading 'flavor' on Instance uuid a038db7d-023b-44ac-a74e-be018b0b6492 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[16989034-7ee5-4dcd-8530-8f8a9b7f0f29]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:06 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:19:06 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:06 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:19:06 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:06 user nova-compute[74892]:   <serial>db4d466c-1c3d-456e-a075-624d63b0252a</serial>
Nov 15 14:19:06 user nova-compute[74892]: </disk>
Nov 15 14:19:06 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42b192f-b52f-451e-b9f5-7fa24ae8efee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8] added
Nov 15 14:19:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26da589-5b55-4ebc-aba1-6dd3fd0a97ad]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d713b39e-a754-4ea5-a7a7-42c43d13a11f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PDYRKNto {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PDYRKNto" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b222e4fe-fbe5-4456-b63d-e9b60589ff29]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PDYRKNto'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6cb574-6f77-424f-b6e7-cfd6a4cd3d00]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d5e272-a09c-481c-a298-8e09f805d7a2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] No waiting events found dispatching network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:06 user nova-compute[74892]: WARNING nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received unexpected event network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 for instance with vm_state active and task_state None.
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-unplugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] No waiting events found dispatching network-vif-unplugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:06 user nova-compute[74892]: WARNING nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received unexpected event network-vif-unplugged-1130e682-747f-499b-9d41-0ed33fd5e873 for instance with vm_state active and task_state rebuilding.
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] No waiting events found dispatching network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:06 user nova-compute[74892]: WARNING nova.compute.manager [req-be2fa7f6-56af-4053-b091-e467aa369c7e req-beabae5e-58b0-4141-aead-3573c4b70b3f service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received unexpected event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 for instance with vm_state active and task_state rebuilding.
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[625db8c2-48f4-4410-8c20-9b0b762adbdb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260]
Nov 15 14:19:06 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4140e2a-4cb3-4745-ab41-19b00c0810e8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebea69ca-fdc2-45d1-8204-6d0e01f38e21]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:06 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[129d2c49-6533-4076-9d4b-9f57082f19fd]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:06 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Took 0.74 seconds to deallocate network for instance.
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-f810be25-23e3-474b-a7fc-ff627d53e664 req-d13a13f6-8984-47cf-8820-6a1078983501 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received event network-vif-deleted-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance destroyed successfully.
Nov 15 14:19:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance destroyed successfully.
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1107235037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336786677',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2KiKDdXeNAqvnhWOe4IokiJsPszuyRac/hr6RiPGlUzitCsmqUIxYtGGZBpsS3bdXKowuUuVkKL67IqO63L//BO28Js1mUKMzps/11gW1kNdrY79SZ72XLSRRQSAhs3A==',key_name='tempest-keypair-1595477803',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92bc8d0616234fdf92d29834bda6d906',ramdisk_id='',reservation_id='r-3s6xwekg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-458086644',owner_user_name='tempest-ServerActionsV293TestJSON-458086644-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:19:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f2936bf65e4ca3be5b6f81718d8a91',uuid=c155e78a-3bb5-46b1-ac34-0bace9450318,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converting VIF {"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_vif [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1130e682-74, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbe1849c-a692-4cb5-94d3-0da05c978f31) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:06 user nova-compute[74892]: INFO os_vif [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74')
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:06 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 14:19:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] No VIF found with MAC fa:16:3e:e8:6d:79, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-db4e7349-ccc7-406e-b04c-19b8fa16cf83 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.302s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:07 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Deleted allocations for instance e03890e3-60d4-4719-a2db-7cc1fe245b11
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0528c24d-603d-496c-9288-59bde9286f5a tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-fcfe76ee-a320-4f8d-a3db-316313e72dc7 req-7286bfd3-7f11-44d3-953b-79a3eb9f5804 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received event network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fcfe76ee-a320-4f8d-a3db-316313e72dc7 req-7286bfd3-7f11-44d3-953b-79a3eb9f5804 service nova] Acquiring lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fcfe76ee-a320-4f8d-a3db-316313e72dc7 req-7286bfd3-7f11-44d3-953b-79a3eb9f5804 service nova] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fcfe76ee-a320-4f8d-a3db-316313e72dc7 req-7286bfd3-7f11-44d3-953b-79a3eb9f5804 service nova] Lock "e03890e3-60d4-4719-a2db-7cc1fe245b11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-fcfe76ee-a320-4f8d-a3db-316313e72dc7 req-7286bfd3-7f11-44d3-953b-79a3eb9f5804 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] No waiting events found dispatching network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:07 user nova-compute[74892]: WARNING nova.compute.manager [req-fcfe76ee-a320-4f8d-a3db-316313e72dc7 req-7286bfd3-7f11-44d3-953b-79a3eb9f5804 service nova] [instance: e03890e3-60d4-4719-a2db-7cc1fe245b11] Received unexpected event network-vif-plugged-591e68d4-53a5-411c-b419-55b0b833abc5 for instance with vm_state deleted and task_state None.
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] <== connect_volume: return (2260ms) {'type': 'block', 'scsi_wwn': '26336313635663236', 'path': '/dev/sdg'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336313635663236', 'path': '/dev/sdg'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.848s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG nova.objects.instance [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lazy-loading 'flavor' on Instance uuid 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[592df57f-3465-4527-b622-a05f4c418841]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:07 user nova-compute[74892]: No targets found.
Nov 15 14:19:07 user nova-compute[74892]: iSNS:
Nov 15 14:19:07 user nova-compute[74892]: No targets found.
Nov 15 14:19:07 user nova-compute[74892]: STATIC:
Nov 15 14:19:07 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82
Nov 15 14:19:07 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:07 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:07 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427
Nov 15 14:19:07 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:07 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:07 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:07 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:07 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:07 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a
Nov 15 14:19:07 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:07 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:07 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:07 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:07 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:07 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b
Nov 15 14:19:07 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:07 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:07 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:07 user nova-compute[74892]: No targets found.
Nov 15 14:19:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:07 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:07 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:19:07 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:07 user nova-compute[74892]:   <source dev="/dev/sdg"/>
Nov 15 14:19:07 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:07 user nova-compute[74892]:   <serial>626065b0-844a-47be-b095-5a5f025014e8</serial>
Nov 15 14:19:07 user nova-compute[74892]: </disk>
Nov 15 14:19:07 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b32410-836a-4473-8d6b-3b0544c3ac1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[753b2e14-e805-45d7-bdec-f8aac6708d80]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:07 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd4cccb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c58fdd-fdad-4802-b247-d82c9c56fde7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bcd19f-8d6c-4f42-9c29-3c35cc50daac]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe9d0eb-1bfc-4db2-a3fd-426759506063]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[88824f90-3fbe-44e0-ad25-58ed749160ae]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[44804c12-223f-41ca-85e7-328e6e5f7d4c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --logout" returned: 0 in 0.174s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb86da8f-c176-4d86-8bf2-982592af7432]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260]
Nov 15 14:19:07 user nova-compute[74892]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9100d862-3e31-42a4-a1f7-a26fea2dc056]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.487s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] <== disconnect_volume: return (1335ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Deleting instance files /opt/stack/data/nova/instances/c155e78a-3bb5-46b1-ac34-0bace9450318_del
Nov 15 14:19:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Deletion of /opt/stack/data/nova/instances/c155e78a-3bb5-46b1-ac34-0bace9450318_del complete
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] No VIF found with MAC fa:16:3e:ff:aa:d8, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2fb4e22d-dd86-44c4-a062-184a6d02f063 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.273s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:08 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c155e78a-3bb5-46b1-ac34-0bace9450318 could not be found.
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:08 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eeee35-3e24-4b59-9a6e-ad658902b0ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:08 user nova-compute[74892]: No targets found.
Nov 15 14:19:08 user nova-compute[74892]: iSNS:
Nov 15 14:19:08 user nova-compute[74892]: No targets found.
Nov 15 14:19:08 user nova-compute[74892]: STATIC:
Nov 15 14:19:08 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82
Nov 15 14:19:08 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:08 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:08 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427
Nov 15 14:19:08 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:08 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:08 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a
Nov 15 14:19:08 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:08 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:08 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:08 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:08 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:08 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b
Nov 15 14:19:08 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:08 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:08 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:08 user nova-compute[74892]: No targets found.
Nov 15 14:19:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:08 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:08 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b012990-cc0f-4e97-9eb5-2c7fc8fe597e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6e6279-add4-4457-a555-cd6f5414820a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:08 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:08 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:08 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:08 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:08 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:08 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:08 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:08 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2015e5f0>, {}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Disconnecting from: [] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] <== disconnect_volume: return (83ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-67951e0d-a970-478b-83ea-0a69e1203236 req-6f0ca796-865a-4b19-a41c-b6c1417f63d3 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received event network-changed-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-67951e0d-a970-478b-83ea-0a69e1203236 req-6f0ca796-865a-4b19-a41c-b6c1417f63d3 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Refreshing instance network info cache due to event network-changed-55f1993f-e400-4ee5-afaf-01695532ac7c. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-67951e0d-a970-478b-83ea-0a69e1203236 req-6f0ca796-865a-4b19-a41c-b6c1417f63d3 service nova] Acquiring lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-67951e0d-a970-478b-83ea-0a69e1203236 req-6f0ca796-865a-4b19-a41c-b6c1417f63d3 service nova] Acquired lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-67951e0d-a970-478b-83ea-0a69e1203236 req-6f0ca796-865a-4b19-a41c-b6c1417f63d3 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Refreshing network info cache for port 55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:08 user nova-compute[74892]: INFO nova.compute.manager [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Detaching volume db4d466c-1c3d-456e-a075-624d63b0252a
Nov 15 14:19:08 user nova-compute[74892]: INFO nova.virt.block_device [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Attempting to driver detach volume db4d466c-1c3d-456e-a075-624d63b0252a from mountpoint /dev/vdb
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Attempting to detach device vdb from instance a038db7d-023b-44ac-a74e-be018b0b6492 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:08 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:08 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:19:08 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:08 user nova-compute[74892]:   <serial>db4d466c-1c3d-456e-a075-624d63b0252a</serial>
Nov 15 14:19:08 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:19:08 user nova-compute[74892]: </disk>
Nov 15 14:19:08 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Successfully detached device vdb from instance a038db7d-023b-44ac-a74e-be018b0b6492 from the persistent domain config.
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a038db7d-023b-44ac-a74e-be018b0b6492 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:19:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:08 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:08 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:19:08 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:08 user nova-compute[74892]:   <serial>db4d466c-1c3d-456e-a075-624d63b0252a</serial>
Nov 15 14:19:08 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:19:08 user nova-compute[74892]: </disk>
Nov 15 14:19:08 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG nova.network.neutron [req-67951e0d-a970-478b-83ea-0a69e1203236 req-6f0ca796-865a-4b19-a41c-b6c1417f63d3 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Updated VIF entry in instance network info cache for port 55f1993f-e400-4ee5-afaf-01695532ac7c. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG nova.network.neutron [req-67951e0d-a970-478b-83ea-0a69e1203236 req-6f0ca796-865a-4b19-a41c-b6c1417f63d3 service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Updating instance_info_cache with network_info: [{"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-67951e0d-a970-478b-83ea-0a69e1203236 req-6f0ca796-865a-4b19-a41c-b6c1417f63d3 service nova] Releasing lock "refresh_cache-f95b420a-69c7-44c0-aba8-0462c1598841" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a038db7d-023b-44ac-a74e-be018b0b6492 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG os_brick.utils [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9597dbd-c7cf-42cc-a465-778699da3097]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c4529-c327-4c32-8eb7-c7b2c6b17133]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b7e8a3-6e1c-4522-9b57-f0ab54e14717]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c129d87a-46dd-4d63-a472-d285b81ee022]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:09 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aa7fce-2950-4aa8-8999-0f56a4ffd678]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG os_brick.utils [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:09 user nova-compute[74892]: INFO nova.compute.manager [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Swapping volume 626065b0-844a-47be-b095-5a5f025014e8 for d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Preparing to wait for external event volume-reimaged-f2ba5dc0-2823-48ed-98ff-bc471a20f00a {{(pid=74892) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lazy-loading 'flavor' on Instance uuid f95b420a-69c7-44c0-aba8-0462c1598841 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:10 user nova-compute[74892]: INFO nova.compute.manager [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Attaching volume 1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 to /dev/sdc
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.utils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[399fc652-18a5-4c77-ba00-27399668c382]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8ce02a-afd5-4b35-be74-95040a517802]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b181d1b-253b-484e-b310-598743182f5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4d332-7ebb-417a-bfba-90b1a92dfd32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:10 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3758cd4-7e7b-42a4-ba6c-4fa6b8fa6a52]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.utils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Updating existing volume attachment record: f60665e2-69cd-4c89-b13f-dd57f3ed162d {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewZsGHEy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:10 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:10 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:10 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294d57f-332c-4449-bb0c-1cb832f576e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:10 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[28154721-8884-4b60-b3a5-b9c48a1fbe7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc] added
Nov 15 14:19:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[56975f42-e5a0-4eea-981a-74b2611aeb21]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed071a9b-dfc4-4431-a6d3-52ae82c15f18]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewZsGHEy {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewZsGHEy" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f1d19-c07d-470d-b958-24b9305394bc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewZsGHEy'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f4f901-baca-4c75-89cf-f2a5b44c4b98]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fcfb51-c981-47ec-95b2-e17253e80acb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:10 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:10 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:10 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:10 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:10 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:10 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:10 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:10 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9863f78-0c0c-4455-b16c-a858393b0945]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc, portal: 172.16.0.220,3260]
Nov 15 14:19:11 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd7a23-7c8b-4a34-a5df-0a2cd7b476af]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad84042-ed88-4a06-a0f9-683ee297a4ba]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:11 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad26c028-a6e4-4d32-ac58-18f786bf87b1]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewZsGHEy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '26361623065663936', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361623065663936', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lazy-loading 'flavor' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:19:12 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:12 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:19:12 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:12 user nova-compute[74892]:   <serial>f714f9d6-fcb7-4824-87d8-08b362c765dc</serial>
Nov 15 14:19:12 user nova-compute[74892]: </disk>
Nov 15 14:19:12 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No BDM found with device name hda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] No VIF found with MAC fa:16:3e:ba:03:b4, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd15c2bb-51c2-4aa2-9899-ffa70fe6d209 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.527s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-717d0fb1-2107-441e-a682-ffc4f778c32a req-20b28890-60cb-4f10-9f42-836d7bf623df service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received event network-changed-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-717d0fb1-2107-441e-a682-ffc4f778c32a req-20b28890-60cb-4f10-9f42-836d7bf623df service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Refreshing instance network info cache due to event network-changed-886325ed-370a-409c-9ffa-281542e4ecae. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-717d0fb1-2107-441e-a682-ffc4f778c32a req-20b28890-60cb-4f10-9f42-836d7bf623df service nova] Acquiring lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-717d0fb1-2107-441e-a682-ffc4f778c32a req-20b28890-60cb-4f10-9f42-836d7bf623df service nova] Acquired lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-717d0fb1-2107-441e-a682-ffc4f778c32a req-20b28890-60cb-4f10-9f42-836d7bf623df service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Refreshing network info cache for port 886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG nova.objects.instance [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lazy-loading 'flavor' on Instance uuid 92b19e94-da7c-4d74-a89a-ea5c709e573c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-717d0fb1-2107-441e-a682-ffc4f778c32a req-20b28890-60cb-4f10-9f42-836d7bf623df service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Updated VIF entry in instance network info cache for port 886325ed-370a-409c-9ffa-281542e4ecae. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-717d0fb1-2107-441e-a682-ffc4f778c32a req-20b28890-60cb-4f10-9f42-836d7bf623df service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Updating instance_info_cache with network_info: [{"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-717d0fb1-2107-441e-a682-ffc4f778c32a req-20b28890-60cb-4f10-9f42-836d7bf623df service nova] Releasing lock "refresh_cache-92b19e94-da7c-4d74-a89a-ea5c709e573c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:13 user nova-compute[74892]: INFO nova.compute.manager [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Attaching volume 2b640d4c-a7f9-49ea-9813-4910743e777a to /dev/vdb
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:13 user nova-compute[74892]: INFO nova.compute.manager [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Detaching volume f714f9d6-fcb7-4824-87d8-08b362c765dc
Nov 15 14:19:14 user nova-compute[74892]: DEBUG os_brick.utils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2c80f6-c55a-4d78-a809-a08eda8e9602]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbecb206-fb27-4056-a8ed-35da65a96cb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:14 user nova-compute[74892]: INFO nova.virt.block_device [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Attempting to driver detach volume f714f9d6-fcb7-4824-87d8-08b362c765dc from mountpoint /dev/vdb
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4a1887-bc2a-44ac-8a7a-c8c40eedf156]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4cee6a-eb08-4a03-a3cc-a8be4a2f3154]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Attempting to detach device vdb from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:14 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:14 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:19:14 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:14 user nova-compute[74892]:   <serial>f714f9d6-fcb7-4824-87d8-08b362c765dc</serial>
Nov 15 14:19:14 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 14:19:14 user nova-compute[74892]: </disk>
Nov 15 14:19:14 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:14 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:19:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3161dbb-b1b6-417c-985e-29c1755bcbf3]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG os_brick.utils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Updating existing volume attachment record: b4785e0b-14e1-4906-9a9f-bcdf05d671c9 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:19:14 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Successfully detached device vdb from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 from the persistent domain config.
Nov 15 14:19:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:14 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:14 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:19:14 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:14 user nova-compute[74892]:   <serial>f714f9d6-fcb7-4824-87d8-08b362c765dc</serial>
Nov 15 14:19:14 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 14:19:14 user nova-compute[74892]: </disk>
Nov 15 14:19:14 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:19:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZNCWnwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:19 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:19 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:19 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[689d4d3a-fdce-4cb1-81a2-8e2ecd977cad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:19 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[660e8f10-0959-4a68-95ed-9605bf5c112e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a] added
Nov 15 14:19:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bd5719-84c0-49db-b2ad-329a9c94470b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a8daf6-9b96-4014-b2be-a03d737cf7f0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZNCWnwL {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JZNCWnwL" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd343b-379f-42c9-8374-964124ebdf64]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JZNCWnwL'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a1ef3-4863-4045-85cf-140c49ceda77]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6e7c58-e24d-4b86-8abf-e0b8caf3f35b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81213ce-509c-4add-bed7-793ac7b93780]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a, portal: 172.16.0.220,3260]
Nov 15 14:19:19 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ceed77-e3e9-429c-a996-a1fe61fbff1f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ea028f-4fdc-4de9-8cf1-daed7f21c232]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:19 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[65753521-2012-4916-aa0c-80070aa28410]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZNCWnwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:20 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:20 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26266376165393037', 'path': '/dev/sdh'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266376165393037', 'path': '/dev/sdh'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:20 user nova-compute[74892]: DEBUG nova.objects.instance [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lazy-loading 'flavor' on Instance uuid 92b19e94-da7c-4d74-a89a-ea5c709e573c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 14:19:20 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:20 user nova-compute[74892]:   <source dev="/dev/sdh"/>
Nov 15 14:19:20 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:20 user nova-compute[74892]:   <serial>2b640d4c-a7f9-49ea-9813-4910743e777a</serial>
Nov 15 14:19:20 user nova-compute[74892]: </disk>
Nov 15 14:19:20 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:19:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] No VIF found with MAC fa:16:3e:1a:d3:cc, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-57f1c47c-0a6f-463d-a988-05ffc17da76c tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.140s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9f8cd44f-a032-48c0-a1d9-773f7bf33c9a tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] volume_snapshot_create: create_info: {'snapshot_id': '9046e58b-ff91-4d71-8851-686140557a88', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74892) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 14:19:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9f8cd44f-a032-48c0-a1d9-773f7bf33c9a tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] snap xml: <domainsnapshot>
Nov 15 14:19:21 user nova-compute[74892]:   <disks>
Nov 15 14:19:21 user nova-compute[74892]:     <disk name="/dev/sdh" snapshot="external" type="file">
Nov 15 14:19:21 user nova-compute[74892]:       <source file="/dev/new_file"/>
Nov 15 14:19:21 user nova-compute[74892]:     </disk>
Nov 15 14:19:21 user nova-compute[74892]:     <disk name="vda" snapshot="no"/>
Nov 15 14:19:21 user nova-compute[74892]:   </disks>
Nov 15 14:19:21 user nova-compute[74892]: </domainsnapshot>
Nov 15 14:19:21 user nova-compute[74892]:  {{(pid=74892) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 14:19:21 user nova-compute[74892]: DEBUG nova.objects.instance [None req-9f8cd44f-a032-48c0-a1d9-773f7bf33c9a tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] Lazy-loading 'system_metadata' on Instance uuid 92b19e94-da7c-4d74-a89a-ea5c709e573c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:21 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9f8cd44f-a032-48c0-a1d9-773f7bf33c9a tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 14:19:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-87d61362-4e8e-4606-99be-8595e82479cf tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] volume_snapshot_delete: delete_info: {'volume_id': '2b640d4c-a7f9-49ea-9813-4910743e777a'} {{(pid=74892) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [None req-87d61362-4e8e-4606-99be-8595e82479cf tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     if delete_info['type'] != 'qcow2':
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] KeyError: 'type'
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [None req-9f8cd44f-a032-48c0-a1d9-773f7bf33c9a tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     rv = execute(f, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     six.reraise(c, e, tb)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     raise value
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     rv = meth(*args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [None req-9f8cd44f-a032-48c0-a1d9-773f7bf33c9a tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     self._volume_snapshot_create(context, instance, guest,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     rv = execute(f, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     six.reraise(c, e, tb)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     raise value
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     rv = meth(*args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [None req-87d61362-4e8e-4606-99be-8595e82479cf tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-51f8aa18-e3da-47e0-8688-7a88fb64c6af)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server [None req-87d61362-4e8e-4606-99be-8595e82479cf tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] Exception during message handling: KeyError: 'type'
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver [None req-9f8cd44f-a032-48c0-a1d9-773f7bf33c9a tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 9046e58b-ff91-4d71-8851-686140557a88 could not be found.
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 9046e58b-ff91-4d71-8851-686140557a88 could not be found. (HTTP 404) (Request-ID: req-9ba634f3-0a0a-49e2-bd7b-a97978549273)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 9046e58b-ff91-4d71-8851-686140557a88 could not be found.
Nov 15 14:19:21 user nova-compute[74892]: ERROR nova.virt.libvirt.driver 
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server [None req-9f8cd44f-a032-48c0-a1d9-773f7bf33c9a tempest-VolumesAssistedSnapshotsTest-1920553170 tempest-VolumesAssistedSnapshotsTest-1920553170-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 14:19:21 user nova-compute[74892]: ERROR oslo_messaging.rpc.server 
Nov 15 14:19:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:22 user nova-compute[74892]: INFO nova.compute.manager [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Detaching volume 2b640d4c-a7f9-49ea-9813-4910743e777a
Nov 15 14:19:22 user nova-compute[74892]: INFO nova.virt.block_device [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Attempting to driver detach volume 2b640d4c-a7f9-49ea-9813-4910743e777a from mountpoint /dev/vdb
Nov 15 14:19:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Attempting to detach device vdb from instance 92b19e94-da7c-4d74-a89a-ea5c709e573c from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:19:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:22 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:22 user nova-compute[74892]:   <source dev="/dev/sdh"/>
Nov 15 14:19:22 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:22 user nova-compute[74892]:   <serial>2b640d4c-a7f9-49ea-9813-4910743e777a</serial>
Nov 15 14:19:22 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:19:22 user nova-compute[74892]: </disk>
Nov 15 14:19:22 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Successfully detached device vdb from instance 92b19e94-da7c-4d74-a89a-ea5c709e573c from the persistent domain config.
Nov 15 14:19:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 92b19e94-da7c-4d74-a89a-ea5c709e573c from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:19:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:22 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:22 user nova-compute[74892]:   <source dev="/dev/sdh"/>
Nov 15 14:19:22 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:22 user nova-compute[74892]:   <serial>2b640d4c-a7f9-49ea-9813-4910743e777a</serial>
Nov 15 14:19:22 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:19:22 user nova-compute[74892]: </disk>
Nov 15 14:19:22 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 92b19e94-da7c-4d74-a89a-ea5c709e573c {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWvFydnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ff18e3b-6d7e-40b2-af8e-958c185cd7dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5d8f644-b278-4a2b-9453-e4321892d75f', 'serial': 'd5d8f644-b278-4a2b-9453-e4321892d75f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '8ff18e3b-6d7e-40b2-af8e-958c185cd7dd', 'attached_at': '', 'detached_at': '', 'volume_id': '626065b0-844a-47be-b095-5a5f025014e8', 'serial'} {{(pid=74892) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWvFydnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:24 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:24 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:24 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[669032b1-ba60-4be9-ad2c-018593172ed9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:24 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyjDBlxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:24 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf5b7be-6256-4ab1-8c8b-ce169363ad94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f] added
Nov 15 14:19:24 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dae34c9-20e4-412b-ae63-d090de17bfc1]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[48192d08-e63c-499c-90b8-ae6b5e759812]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWvFydnl {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWvFydnl" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[902c8b8a-4524-4f94-a5c2-af2495b5fea8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QWvFydnl'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4843a7b6-ab9b-40a3-9956-87cf86f04005]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f394b-fc15-49c6-a077-3f75cf45b546]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[87379de5-9597-4e64-b7b6-9cdca9154b0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f, portal: 172.16.0.220,3260]
Nov 15 14:19:24 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:24 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0256af-2e6b-4ff3-a392-cbeb7d4fbb59]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d9e4f8-4589-45b3-be4e-66d3a4ffcc7b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:24 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:24 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc66c40-45d3-4edf-8019-fd9238431469]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWvFydnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-0d1a3253-a194-42a6-adcc-93bf7fe31f22 req-c77e9fff-05d5-4be0-af1f-29008e50caed service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-changed-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-0d1a3253-a194-42a6-adcc-93bf7fe31f22 req-c77e9fff-05d5-4be0-af1f-29008e50caed service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing instance network info cache due to event network-changed-c1621ad1-87e8-436b-830e-a48822c95049. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0d1a3253-a194-42a6-adcc-93bf7fe31f22 req-c77e9fff-05d5-4be0-af1f-29008e50caed service nova] Acquiring lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0d1a3253-a194-42a6-adcc-93bf7fe31f22 req-c77e9fff-05d5-4be0-af1f-29008e50caed service nova] Acquired lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG nova.network.neutron [req-0d1a3253-a194-42a6-adcc-93bf7fe31f22 req-c77e9fff-05d5-4be0-af1f-29008e50caed service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Refreshing network info cache for port c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG nova.network.neutron [req-0d1a3253-a194-42a6-adcc-93bf7fe31f22 req-c77e9fff-05d5-4be0-af1f-29008e50caed service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updated VIF entry in instance network info cache for port c1621ad1-87e8-436b-830e-a48822c95049. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG nova.network.neutron [req-0d1a3253-a194-42a6-adcc-93bf7fe31f22 req-c77e9fff-05d5-4be0-af1f-29008e50caed service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [{"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0d1a3253-a194-42a6-adcc-93bf7fe31f22 req-c77e9fff-05d5-4be0-af1f-29008e50caed service nova] Releasing lock "refresh_cache-a44f26ed-88ff-486e-929f-141e51009aad" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23262656663356232', 'path': '/dev/sdj'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262656663356232', 'path': '/dev/sdj'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.314s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:25 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:25 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lazy-loading 'flavor' on Instance uuid 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a39bf-055d-4140-a2f2-4be547621963]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:25 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48bf54b-4d05-4424-a057-c78ffaba42d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668] added
Nov 15 14:19:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c268f2-b151-414f-a853-f74b205a2033]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8392c28a-8f2e-40a0-9ec7-0be3d4ee75e1]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyjDBlxH {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyjDBlxH" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[57218d97-5f6e-4fc0-8239-aa827564074c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NyjDBlxH'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8496db8e-c621-4eea-855c-208d148aa54f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2afd95-f586-4526-a9ea-f6c22e99722f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e055d4f-e6f5-4d1b-8f46-9c980e7d9d47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668, portal: 172.16.0.220,3260]
Nov 15 14:19:25 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aaa590-b3c4-452a-8246-843139f6a5f6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda28734-1fdc-4d91-8364-f597f83d5010]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:25 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:25 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8bdffd-b22f-4789-82c5-78c74e2f8f00]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:25 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyjDBlxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 196083712 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] <== connect_volume: return (2689ms) {'type': 'block', 'scsi_wwn': '26162623661336366', 'path': '/dev/sdk'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162623661336366', 'path': '/dev/sdk'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lazy-loading 'flavor' on Instance uuid f95b420a-69c7-44c0-aba8-0462c1598841 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:19:26 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:26 user nova-compute[74892]:   <source dev="/dev/sdk"/>
Nov 15 14:19:26 user nova-compute[74892]:   <target dev="sdc" bus="scsi"/>
Nov 15 14:19:26 user nova-compute[74892]:   <serial>1b7e99dc-6e21-4a46-ada5-bc42b3ae2668</serial>
Nov 15 14:19:26 user nova-compute[74892]:   <address type="drive" controller="0" unit="2"/>
Nov 15 14:19:26 user nova-compute[74892]: </disk>
Nov 15 14:19:26 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 347078656 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] No BDM found with device name sda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] No VIF found with MAC fa:16:3e:f0:e7:5a, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 550502400 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-13784776-3666-4299-9167-ee9519ca3bca tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.527s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "a44f26ed-88ff-486e-929f-141e51009aad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.012s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:27 user nova-compute[74892]: INFO nova.compute.manager [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Terminating instance
Nov 15 14:19:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 716177408 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3cf9713-21e7-436c-ac92-39ac90d277f7 req-33d9db51-0ebd-4b0f-bbe8-772bcdff38a5 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3cf9713-21e7-436c-ac92-39ac90d277f7 req-33d9db51-0ebd-4b0f-bbe8-772bcdff38a5 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3cf9713-21e7-436c-ac92-39ac90d277f7 req-33d9db51-0ebd-4b0f-bbe8-772bcdff38a5 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3cf9713-21e7-436c-ac92-39ac90d277f7 req-33d9db51-0ebd-4b0f-bbe8-772bcdff38a5 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3cf9713-21e7-436c-ac92-39ac90d277f7 req-33d9db51-0ebd-4b0f-bbe8-772bcdff38a5 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-unplugged-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3cf9713-21e7-436c-ac92-39ac90d277f7 req-33d9db51-0ebd-4b0f-bbe8-772bcdff38a5 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-c1621ad1-87e8-436b-830e-a48822c95049 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-90110a17-0625-4a45-8b88-5bd0dda623d3 req-d7ab73df-4561-416e-b5ae-b959a5dc1fc1 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-90110a17-0625-4a45-8b88-5bd0dda623d3 req-d7ab73df-4561-416e-b5ae-b959a5dc1fc1 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-90110a17-0625-4a45-8b88-5bd0dda623d3 req-d7ab73df-4561-416e-b5ae-b959a5dc1fc1 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-90110a17-0625-4a45-8b88-5bd0dda623d3 req-d7ab73df-4561-416e-b5ae-b959a5dc1fc1 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-90110a17-0625-4a45-8b88-5bd0dda623d3 req-d7ab73df-4561-416e-b5ae-b959a5dc1fc1 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-unplugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-90110a17-0625-4a45-8b88-5bd0dda623d3 req-d7ab73df-4561-416e-b5ae-b959a5dc1fc1 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 861929472 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:28 user nova-compute[74892]: INFO nova.compute.manager [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Detaching volume 1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: INFO nova.virt.block_device [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Attempting to driver detach volume 1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 from mountpoint /dev/sdc
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Attempting to detach device sdc from instance f95b420a-69c7-44c0-aba8-0462c1598841 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:28 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:28 user nova-compute[74892]:   <source dev="/dev/sdk"/>
Nov 15 14:19:28 user nova-compute[74892]:   <target dev="sdc" bus="scsi"/>
Nov 15 14:19:28 user nova-compute[74892]:   <serial>1b7e99dc-6e21-4a46-ada5-bc42b3ae2668</serial>
Nov 15 14:19:28 user nova-compute[74892]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 14:19:28 user nova-compute[74892]: </disk>
Nov 15 14:19:28 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Successfully detached device sdc from instance f95b420a-69c7-44c0-aba8-0462c1598841 from the persistent domain config.
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f95b420a-69c7-44c0-aba8-0462c1598841 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:28 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:28 user nova-compute[74892]:   <source dev="/dev/sdk"/>
Nov 15 14:19:28 user nova-compute[74892]:   <target dev="sdc" bus="scsi"/>
Nov 15 14:19:28 user nova-compute[74892]:   <serial>1b7e99dc-6e21-4a46-ada5-bc42b3ae2668</serial>
Nov 15 14:19:28 user nova-compute[74892]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 14:19:28 user nova-compute[74892]: </disk>
Nov 15 14:19:28 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 1000341504 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:29 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a038db7d-023b-44ac-a74e-be018b0b6492 is timed out.
Nov 15 14:19:29 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Successfully detached device vdb from instance a038db7d-023b-44ac-a74e-be018b0b6492 from the live domain config.
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OlQPgwNV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:29 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f95b420a-69c7-44c0-aba8-0462c1598841 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf29c05-d208-4e21-b149-996e7753fcee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:29 user nova-compute[74892]: No targets found.
Nov 15 14:19:29 user nova-compute[74892]: iSNS:
Nov 15 14:19:29 user nova-compute[74892]: No targets found.
Nov 15 14:19:29 user nova-compute[74892]: STATIC:
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:29 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:29 user nova-compute[74892]: No targets found.
Nov 15 14:19:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:29 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:29 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e638540e-6f4c-4a82-98fb-ac0c003f3635]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-fd8d207b-d751-4e4d-b1ce-9139d998798c req-c09b01cb-886c-4273-9c94-4b39bf673df1 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fd8d207b-d751-4e4d-b1ce-9139d998798c req-c09b01cb-886c-4273-9c94-4b39bf673df1 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fd8d207b-d751-4e4d-b1ce-9139d998798c req-c09b01cb-886c-4273-9c94-4b39bf673df1 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fd8d207b-d751-4e4d-b1ce-9139d998798c req-c09b01cb-886c-4273-9c94-4b39bf673df1 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-fd8d207b-d751-4e4d-b1ce-9139d998798c req-c09b01cb-886c-4273-9c94-4b39bf673df1 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-unplugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-fd8d207b-d751-4e4d-b1ce-9139d998798c req-c09b01cb-886c-4273-9c94-4b39bf673df1 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cc72ca-33da-442c-a790-05502f83e102]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:29 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2015eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a'): ({'sdf'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Removing single pathed devices sdf {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[db241ad9-959e-4658-a297-d87bea27057b]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a927fa-1ad9-47d2-ac8c-c1c7e12b4535]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Flushing IO for device /dev/sdf {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0042d2-d157-4310-a8da-55ca721eb84e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[360bf2bc-458b-4735-947c-8f7a42ffba01]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f4f7d6-759e-4956-8388-778e3371d0b4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --logout" returned: 0 in 0.112s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e478608-785a-4821-bfa0-d4cb264fd5a2]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a, portal: 172.16.0.220,3260]
Nov 15 14:19:29 user nova-compute[74892]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db4d466c-1c3d-456e-a075-624d63b0252a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[af185620-108e-4c3f-b0f7-ad2f725dad50]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.500s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] <== disconnect_volume: return (502ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:29 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ace150-665f-40cf-a924-9df8426e82d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:30 user nova-compute[74892]: No targets found.
Nov 15 14:19:30 user nova-compute[74892]: iSNS:
Nov 15 14:19:30 user nova-compute[74892]: No targets found.
Nov 15 14:19:30 user nova-compute[74892]: STATIC:
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:30 user nova-compute[74892]: No targets found.
Nov 15 14:19:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:30 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:30 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec40419-d659-40b2-b10a-f835179a0a71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[11136de1-cb58-4d27-95f1-5d65e8412116]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:30 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2015fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8'): ({'sdg'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Removing single pathed devices sdg {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2882896-ead7-4c5c-b96b-02c2a69a42bf]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[df78d2fc-5ec2-44df-abd4-6fdacc8e6e39]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Flushing IO for device /dev/sdg {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[123d43b5-4ddd-47cc-b2e7-bc7747a85cd5]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Instance destroyed successfully.
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lazy-loading 'resources' on Instance uuid a44f26ed-88ff-486e-929f-141e51009aad {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=c1621ad1-87e8-436b-830e-a48822c95049,network=Network(31dd564a-91a8-4d2e-87a3-12b09f3aa0ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1621ad1-87') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=c1621ad1-87e8-436b-830e-a48822c95049,network=Network(31dd564a-91a8-4d2e-87a3-12b09f3aa0ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1621ad1-87') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9090dba3-7c50-419f-9982-eaa428d01b11]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] SCSI volumes sdg have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1621ad1-87, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:30 user nova-compute[74892]: WARNING nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-c1621ad1-87e8-436b-830e-a48822c95049 for instance with vm_state active and task_state deleting.
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-unplugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:30 user nova-compute[74892]: WARNING nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 for instance with vm_state active and task_state deleting.
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-unplugged-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a57d684-3091-4d1e-b04a-da2f800f77f6 req-931c71aa-dfc5-44b4-aab0-b75a535ea9c4 service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-67d418cb-b295-4fe3-857d-fa7eb1244168 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3c28dfe0-c6165f26de572aba', '/dev/disk/by-id/scsi-26336313635663236', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c28dfe0') {{(pid=85038) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[02906a68-eef5-4d3a-9eb8-8cf6bb493a6f]: (4, None) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc08e4b-8de1-45fa-944d-3e2f8c8993fe]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05f76865-d8e4-42a6-9a0f-53fa710de048) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: INFO os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:3a:b3,bridge_name='br-int',has_traffic_filtering=True,id=c1621ad1-87e8-436b-830e-a48822c95049,network=Network(31dd564a-91a8-4d2e-87a3-12b09f3aa0ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1621ad1-87')
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:06:2f,bridge_name='br-int',has_traffic_filtering=True,id=67540ebd-51b4-4a04-9900-3c0d1e8d4364,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67540ebd-51') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:06:2f,bridge_name='br-int',has_traffic_filtering=True,id=67540ebd-51b4-4a04-9900-3c0d1e8d4364,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67540ebd-51') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67540ebd-51, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbd06a8-90bf-4362-9195-5964f8eb6959]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260]
Nov 15 14:19:30 user nova-compute[74892]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c493f5-877a-4af9-8da5-b32d2824a141]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.514s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] <== disconnect_volume: return (517ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72cf5650-04f1-454e-8990-fa4400c0461e) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-628c3f44-4814-4bdf-8cac-364aba234648 req-ccc627f1-e5b9-4e1c-9876-348c593a52ff service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-628c3f44-4814-4bdf-8cac-364aba234648 req-ccc627f1-e5b9-4e1c-9876-348c593a52ff service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-628c3f44-4814-4bdf-8cac-364aba234648 req-ccc627f1-e5b9-4e1c-9876-348c593a52ff service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-628c3f44-4814-4bdf-8cac-364aba234648 req-ccc627f1-e5b9-4e1c-9876-348c593a52ff service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-628c3f44-4814-4bdf-8cac-364aba234648 req-ccc627f1-e5b9-4e1c-9876-348c593a52ff service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:30 user nova-compute[74892]: WARNING nova.compute.manager [req-628c3f44-4814-4bdf-8cac-364aba234648 req-ccc627f1-e5b9-4e1c-9876-348c593a52ff service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-67540ebd-51b4-4a04-9900-3c0d1e8d4364 for instance with vm_state active and task_state deleting.
Nov 15 14:19:30 user nova-compute[74892]: INFO os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:06:2f,bridge_name='br-int',has_traffic_filtering=True,id=67540ebd-51b4-4a04-9900-3c0d1e8d4364,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap67540ebd-51')
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:3f:43,bridge_name='br-int',has_traffic_filtering=True,id=5bdbd29b-ae5f-41f5-880a-947f3cd55259,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdbd29b-ae') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:3f:43,bridge_name='br-int',has_traffic_filtering=True,id=5bdbd29b-ae5f-41f5-880a-947f3cd55259,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdbd29b-ae') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bdbd29b-ae, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWvFydnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '8ff18e3b-6d7e-40b2-af8e-958c185cd7dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5d8f644-b278-4a2b-9453-e4321892d75f', 'serial'} {{(pid=74892) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] swap_volume: removing Cinder connection for volume 626065b0-844a-47be-b095-5a5f025014e8 {{(pid=74892) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33b8297d-090d-40d9-a016-8f6d5dd12d3f) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: INFO os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:3f:43,bridge_name='br-int',has_traffic_filtering=True,id=5bdbd29b-ae5f-41f5-880a-947f3cd55259,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5bdbd29b-ae')
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "address": "fa:16:3e:b2:e9:72", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f1b4b99-7b", "ovs_interfaceid": "6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e9:72,bridge_name='br-int',has_traffic_filtering=True,id=6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1b4b99-7b') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e9:72,bridge_name='br-int',has_traffic_filtering=True,id=6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1b4b99-7b') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f1b4b99-7b, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7793d68d-4af0-417b-bf1f-3c27efcdcc5a) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: INFO os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e9:72,bridge_name='br-int',has_traffic_filtering=True,id=6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f1b4b99-7b')
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbaf3e2-21') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbaf3e2-21') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacbaf3e2-21, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b818ffc-865d-43ee-b776-5ccec8bb8da8) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: INFO os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:fc:73,bridge_name='br-int',has_traffic_filtering=True,id=acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3,network=Network(4d154670-cee1-4ca9-aff9-427a86070ec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacbaf3e2-21')
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:e2,bridge_name='br-int',has_traffic_filtering=True,id=67d418cb-b295-4fe3-857d-fa7eb1244168,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d418cb-b2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:e2,bridge_name='br-int',has_traffic_filtering=True,id=67d418cb-b295-4fe3-857d-fa7eb1244168,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d418cb-b2') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67d418cb-b2, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2efe3a6-d28d-4f0b-ba2f-eb2ab7f4b3bf) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: INFO os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:e2,bridge_name='br-int',has_traffic_filtering=True,id=67d418cb-b295-4fe3-857d-fa7eb1244168,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67d418cb-b2')
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1809967087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1809967087',id=12,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNNWMQzSNAa2rcEOBoCb0WDFkaRNnU0oz2ERiLP8jwRIz3hfA8hMfmoUaT2qBUFHw5XZmcSxwWTxSb1if9tTUJ+hz8uaIxiuF1ZbRbqHHMT4z/l+X/TpS3Ap360Ao90MA==',key_name='tempest-keypair-204928990',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:18:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='532a7e7ab572451690b43490840b3a78',ramdisk_id='',reservation_id='r-318v0f23',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-512234093',owner_user_name='tempest-TaggedBootDevicesTest_v242-512234093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33c01685d0044a389ad69dcdf99737e9',uuid=a44f26ed-88ff-486e-929f-141e51009aad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converting VIF {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:43:7c,bridge_name='br-int',has_traffic_filtering=True,id=fa49ca22-dd97-4732-9e2d-b579298c6f58,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa49ca22-dd') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:43:7c,bridge_name='br-int',has_traffic_filtering=True,id=fa49ca22-dd97-4732-9e2d-b579298c6f58,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa49ca22-dd') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa49ca22-dd, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8035ff97-f47a-424c-b1c6-1ffd310b24c5) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:30 user nova-compute[74892]: INFO os_vif [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:43:7c,bridge_name='br-int',has_traffic_filtering=True,id=fa49ca22-dd97-4732-9e2d-b579298c6f58,network=Network(b13ac20f-084b-419b-a353-460ac968d4b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa49ca22-dd')
Nov 15 14:19:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVYcikyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:30 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ced1ca-eb7c-4afd-95e1-92289e970a98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:30 user nova-compute[74892]: No targets found.
Nov 15 14:19:30 user nova-compute[74892]: iSNS:
Nov 15 14:19:30 user nova-compute[74892]: No targets found.
Nov 15 14:19:30 user nova-compute[74892]: STATIC:
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:30 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:30 user nova-compute[74892]: No targets found.
Nov 15 14:19:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:30 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:30 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00bc9b7-d383-42ad-a321-44dc50e7c11b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[157ec906-da76-461b-b259-2fd278da8795]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd205b1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427'): ({'sde'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Removing single pathed devices sde {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[00669922-d7b0-4b91-9796-f2e6bbd8d4db]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0598ba6-e02e-44d6-a502-81aba3cbacd2]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Flushing IO for device /dev/sde {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[036df5e8-fbb9-4d2f-87d7-c37806fb06fe]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb1bf7e-559b-47be-aec3-1dcedf0f21ff]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d103d06b-5b96-4020-be91-03c20ae11afb]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2499bc66-9e0f-41b3-998e-6bf076207dd0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427, portal: 172.16.0.220,3260]
Nov 15 14:19:31 user nova-compute[74892]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:106e4496-4dc4-46fb-92b9-9d944c424427 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6025104-c1a2-4023-9cce-d67ca503ca68]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== disconnect_volume: return (378ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qyZFctih', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:31 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[33222023-9cc8-4690-b2f4-ab4db200af7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:31 user nova-compute[74892]: No targets found.
Nov 15 14:19:31 user nova-compute[74892]: iSNS:
Nov 15 14:19:31 user nova-compute[74892]: No targets found.
Nov 15 14:19:31 user nova-compute[74892]: STATIC:
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:31 user nova-compute[74892]: No targets found.
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:31 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:31 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c410fad3-c82f-4137-a485-4355303fe395]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4c2792-28e8-41f1-9a4a-f362bdb2fcee]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd202bfeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82'): ({'sdd'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Removing single pathed devices sdd {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lazy-loading 'flavor' on Instance uuid a038db7d-023b-44ac-a74e-be018b0b6492 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6e85d3-3ffb-43e2-98ac-1645e3c2a982]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea478c3e-6c0c-45be-a1a1-53b81542443b]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Flushing IO for device /dev/sdd {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d47e5f4-3334-4607-aa39-fb5f8012df8d tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.561s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e0e28d-d2a8-438a-ada5-a08aaeb31c85]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[32816f4f-33ef-45c0-973b-0b5bbf3db288]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] SCSI volumes sdd have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d91213e-9c55-4118-a693-b03913148074]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:31 user nova-compute[74892]: WARNING nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-5bdbd29b-ae5f-41f5-880a-947f3cd55259 for instance with vm_state active and task_state deleting.
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-unplugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:31 user nova-compute[74892]: WARNING nova.compute.manager [req-ea92079e-a7f7-477a-9d3e-283d9e5eac51 req-0ed28222-86b4-4a3a-9616-3e7e6c004a8f service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 for instance with vm_state active and task_state deleting.
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b56fa5-297a-400a-badd-31fc56c2171b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82, portal: 172.16.0.220,3260]
Nov 15 14:19:31 user nova-compute[74892]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2253dba5-f94a-4d96-8a6c-e35ff352ce82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[44606f0c-e506-455a-a520-c586909c72ce]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== disconnect_volume: return (340ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oBfdiAJw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:31 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa26ee1b-0f25-4b78-8a13-457dc0bf73a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:31 user nova-compute[74892]: No targets found.
Nov 15 14:19:31 user nova-compute[74892]: iSNS:
Nov 15 14:19:31 user nova-compute[74892]: No targets found.
Nov 15 14:19:31 user nova-compute[74892]: STATIC:
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:31 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:31 user nova-compute[74892]: No targets found.
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:31 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:31 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] swap_volume: Updating volume 626065b0-844a-47be-b095-5a5f025014e8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "QWvFydnl", "auth_password": "Tfpdcj39M5bEzi", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "d5d8f644-b278-4a2b-9453-e4321892d75f"}, "status": "reserved", "instance": "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd", "attached_at": "", "detached_at": "", "volume_id": "d5d8f644-b278-4a2b-9453-e4321892d75f", "serial": "d5d8f644-b278-4a2b-9453-e4321892d75f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd5d8f644-b278-4a2b-9453-e4321892d75f', 'no_device': None, 'attachment_id': 'a830c8e7-392d-4a4f-8f5b-7371aecf9a2c'} {{(pid=74892) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1ed0bc38-072e-4e28-8518-e1efcc592110 tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.164s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d0b1ae-4132-4b76-b5f8-cf9be6d2a032]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c6f16-d657-4223-afcb-9400912e1e69]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:31 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd007c9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c565b7-2e5e-4573-97cd-fb76609d8419]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a171da9-f7b3-449a-8574-fe62b509d4a1]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b100c6b3-2273-4944-bacb-debadac9cb6c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[74952685-a49b-4398-bc86-9d18a0a18f42]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec010da-2347-4698-8df0-abc080a06579]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.128s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[937a08e1-3946-4ecc-8526-63bde44de379]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b, portal: 172.16.0.220,3260]
Nov 15 14:19:31 user nova-compute[74892]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa31c72-2591-421d-81a8-6b3978425f8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[37693177-68e1-40a7-b58a-e42f49c6c590]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] <== disconnect_volume: return (397ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Deleting instance files /opt/stack/data/nova/instances/a44f26ed-88ff-486e-929f-141e51009aad_del
Nov 15 14:19:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Deletion of /opt/stack/data/nova/instances/a44f26ed-88ff-486e-929f-141e51009aad_del complete
Nov 15 14:19:32 user nova-compute[74892]: INFO nova.compute.manager [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Took 4.31 seconds to destroy the instance on the hypervisor.
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a44f26ed-88ff-486e-929f-141e51009aad] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:32 user nova-compute[74892]: WARNING nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-67d418cb-b295-4fe3-857d-fa7eb1244168 for instance with vm_state active and task_state deleting.
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-unplugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-unplugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Acquiring lock "a44f26ed-88ff-486e-929f-141e51009aad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] Lock "a44f26ed-88ff-486e-929f-141e51009aad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] No waiting events found dispatching network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:32 user nova-compute[74892]: WARNING nova.compute.manager [req-7a761e3c-1462-480a-adc5-843dbb8d2e78 req-6dcb8e6f-cb57-4d10-8f80-88b078a9fa7c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received unexpected event network-vif-plugged-fa49ca22-dd97-4732-9e2d-b579298c6f58 for instance with vm_state active and task_state deleting.
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG os_brick.utils [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[90234679-9999-4548-a6e9-e382f16c286b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42eb662-37cb-4fac-b9ad-045def99d355]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b9a361-2144-427c-9b78-8e9ff52ae3ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd6a811-1937-413a-96e4-1b8cf32cff0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:33 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:19:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1bdb2d-5a3d-4359-b21f-a7f64c60042a]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:19:33 user nova-compute[74892]: DEBUG os_brick.utils [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:33 user nova-compute[74892]: INFO nova.compute.manager [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Swapping volume d5d8f644-b278-4a2b-9453-e4321892d75f for 626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-250bc8fe-f784-4583-90e9-2e631fd62f7e req-91e673eb-f9a6-4477-9d11-4a485b72c5fc service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-deleted-6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:34 user nova-compute[74892]: INFO nova.compute.manager [req-250bc8fe-f784-4583-90e9-2e631fd62f7e req-91e673eb-f9a6-4477-9d11-4a485b72c5fc service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Neutron deleted interface 6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8; detaching it from the instance and deleting it from the info cache
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-250bc8fe-f784-4583-90e9-2e631fd62f7e req-91e673eb-f9a6-4477-9d11-4a485b72c5fc service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [{"id": "c1621ad1-87e8-436b-830e-a48822c95049", "address": "fa:16:3e:33:3a:b3", "network": {"id": "31dd564a-91a8-4d2e-87a3-12b09f3aa0ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1567721076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1621ad1-87", "ovs_interfaceid": "c1621ad1-87e8-436b-830e-a48822c95049", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-250bc8fe-f784-4583-90e9-2e631fd62f7e req-91e673eb-f9a6-4477-9d11-4a485b72c5fc service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Detach interface failed, port_id=6f1b4b99-7b4e-4b61-9d1b-2951cbdd79b8, reason: Instance a44f26ed-88ff-486e-929f-141e51009aad could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-250bc8fe-f784-4583-90e9-2e631fd62f7e req-91e673eb-f9a6-4477-9d11-4a485b72c5fc service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-deleted-c1621ad1-87e8-436b-830e-a48822c95049 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:34 user nova-compute[74892]: INFO nova.compute.manager [req-250bc8fe-f784-4583-90e9-2e631fd62f7e req-91e673eb-f9a6-4477-9d11-4a485b72c5fc service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Neutron deleted interface c1621ad1-87e8-436b-830e-a48822c95049; detaching it from the instance and deleting it from the info cache
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-250bc8fe-f784-4583-90e9-2e631fd62f7e req-91e673eb-f9a6-4477-9d11-4a485b72c5fc service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [{"id": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "address": "fa:16:3e:c3:06:2f", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67540ebd-51", "ovs_interfaceid": "67540ebd-51b4-4a04-9900-3c0d1e8d4364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "address": "fa:16:3e:62:3f:43", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bdbd29b-ae", "ovs_interfaceid": "5bdbd29b-ae5f-41f5-880a-947f3cd55259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "address": "fa:16:3e:13:fc:73", "network": {"id": "4d154670-cee1-4ca9-aff9-427a86070ec6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1783998664", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacbaf3e2-21", "ovs_interfaceid": "acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67d418cb-b295-4fe3-857d-fa7eb1244168", "address": "fa:16:3e:07:b0:e2", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67d418cb-b2", "ovs_interfaceid": "67d418cb-b295-4fe3-857d-fa7eb1244168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "address": "fa:16:3e:9a:43:7c", "network": {"id": "b13ac20f-084b-419b-a353-460ac968d4b3", "bridge": "br-int", "label": "tempest-device-tagging-net2-882375508", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "532a7e7ab572451690b43490840b3a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa49ca22-dd", "ovs_interfaceid": "fa49ca22-dd97-4732-9e2d-b579298c6f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-250bc8fe-f784-4583-90e9-2e631fd62f7e req-91e673eb-f9a6-4477-9d11-4a485b72c5fc service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Detach interface failed, port_id=c1621ad1-87e8-436b-830e-a48822c95049, reason: Instance a44f26ed-88ff-486e-929f-141e51009aad could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:19:34 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 is timed out.
Nov 15 14:19:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Successfully detached device vdb from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 from the live domain config.
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewZsGHEy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:34 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b034f8-4c08-44aa-b92c-4702274db30b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:34 user nova-compute[74892]: No targets found.
Nov 15 14:19:34 user nova-compute[74892]: iSNS:
Nov 15 14:19:34 user nova-compute[74892]: No targets found.
Nov 15 14:19:34 user nova-compute[74892]: STATIC:
Nov 15 14:19:34 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:34 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:34 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:34 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a
Nov 15 14:19:34 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:34 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:34 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc
Nov 15 14:19:34 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:34 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:34 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:34 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:34 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:34 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:34 user nova-compute[74892]: No targets found.
Nov 15 14:19:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:34 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:34 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d47216b-7f32-4ef4-a7ed-86c252d4a06f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce354dd-e129-424f-addc-b252ff856eac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:34 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:34 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:34 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:34 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:34 user nova-compute[74892]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc (non-flash)
Nov 15 14:19:34 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2015d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a793b757-ab57-4f89-b6e3-b9e5b7dc6529]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41397d1-5c5e-453e-b8d1-5334b3a2c26c]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3541fd-8b39-4615-ac99-012e0e4d23de]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-4617d02e-03c1-4906-b928-a71b37e343c8 req-4f6991f4-94b6-479d-bc7a-b24bc9820491 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event volume-reimaged-f2ba5dc0-2823-48ed-98ff-bc471a20f00a {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4617d02e-03c1-4906-b928-a71b37e343c8 req-4f6991f4-94b6-479d-bc7a-b24bc9820491 service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4617d02e-03c1-4906-b928-a71b37e343c8 req-4f6991f4-94b6-479d-bc7a-b24bc9820491 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4617d02e-03c1-4906-b928-a71b37e343c8 req-4f6991f4-94b6-479d-bc7a-b24bc9820491 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-4617d02e-03c1-4906-b928-a71b37e343c8 req-4f6991f4-94b6-479d-bc7a-b24bc9820491 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Processing event volume-reimaged-f2ba5dc0-2823-48ed-98ff-bc471a20f00a {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance event wait completed in 24 seconds for volume-reimaged {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[91015ad9-7314-416e-a1e9-0c9c28b23356]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8366c8f9-74fc-4a67-814a-c74fcd95ebc7]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: INFO nova.virt.block_device [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Booting with volume f2ba5dc0-2823-48ed-98ff-bc471a20f00a at /dev/vda
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd4d0e7-3de1-4617-87a4-f66a776e447e]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc, portal: 172.16.0.220,3260]
Nov 15 14:19:34 user nova-compute[74892]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG os_brick.utils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f714f9d6-fcb7-4824-87d8-08b362c765dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fc4497-05ca-4b6d-81a6-f10b501dcfa6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] <== disconnect_volume: return (315ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[077d5cd8-d910-4209-bb5c-e16d3a666316]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc014011-5c77-4d18-be69-1cc4cc550b07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fce741-fd19-42c7-858d-b4d98b4939a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d1429e-a338-4b08-ae88-0083fc612596]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:35 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[65095991-5282-4ee0-bb97-1fa673b7c6a7]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG os_brick.utils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Updating existing volume attachment record: a96bbf8d-c26e-41b7-9b65-560212870a05 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:35 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Took 3.41 seconds to deallocate network for instance.
Nov 15 14:19:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lazy-loading 'flavor' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-488dac7d-13c4-4496-bf69-a9c8aaf1ae5f tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.916s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-f5ecfbfa-24ae-4515-9d61-a957a93a7551 req-e562c5f5-2ca1-479d-a42e-9c80c9e2433c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-deleted-acbaf3e2-21d1-42a9-9f37-26eb4f57c8c3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-f5ecfbfa-24ae-4515-9d61-a957a93a7551 req-e562c5f5-2ca1-479d-a42e-9c80c9e2433c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-deleted-67d418cb-b295-4fe3-857d-fa7eb1244168 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-f5ecfbfa-24ae-4515-9d61-a957a93a7551 req-e562c5f5-2ca1-479d-a42e-9c80c9e2433c service nova] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Received event network-vif-deleted-fa49ca22-dd97-4732-9e2d-b579298c6f58 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "interface-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-8c8e3c8d-0fec-4955-980b-4ab9ec27e072" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "interface-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-8c8e3c8d-0fec-4955-980b-4ab9ec27e072" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.objects.instance [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lazy-loading 'flavor' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converting VIF {"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface> {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface> {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Attempting to detach device tap8c8e3c8d-0f from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] detach device xml: <interface type="ethernet">
Nov 15 14:19:36 user nova-compute[74892]:   <mac address="fa:16:3e:74:64:d0"/>
Nov 15 14:19:36 user nova-compute[74892]:   <model type="virtio"/>
Nov 15 14:19:36 user nova-compute[74892]:   <mtu size="1442"/>
Nov 15 14:19:36 user nova-compute[74892]:   <target dev="tap8c8e3c8d-0f"/>
Nov 15 14:19:36 user nova-compute[74892]: </interface>
Nov 15 14:19:36 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface> {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 15 14:19:36 user nova-compute[74892]:   <name>instance-00000007</name>
Nov 15 14:19:36 user nova-compute[74892]:   <uuid>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</uuid>
Nov 15 14:19:36 user nova-compute[74892]:   <metadata>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:36 user nova-compute[74892]:   <nova:package version="0.0.0"/>
Nov 15 14:19:36 user nova-compute[74892]:   <nova:name>tempest-device-tagging-server-1329550711</nova:name>
Nov 15 14:19:36 user nova-compute[74892]:   <nova:creationTime>2023-11-15 14:19:04</nova:creationTime>
Nov 15 14:19:36 user nova-compute[74892]:   <nova:flavor name="m1.tiny">
Nov 15 14:19:36 user nova-compute[74892]:     <nova:memory>512</nova:memory>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:disk>1</nova:disk>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:swap>0</nova:swap>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:36 user nova-compute[74892]:   </nova:flavor>
Nov 15 14:19:36 user nova-compute[74892]:   <nova:owner>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:user uuid="096ca6cfce6b437f85f220646f97b902">tempest-TaggedAttachmentsTest-785094056-project-member</nova:user>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:project uuid="446202d935a749749fbba99be6a1d00c">tempest-TaggedAttachmentsTest-785094056</nova:project>
Nov 15 14:19:36 user nova-compute[74892]:   </nova:owner>
Nov 15 14:19:36 user nova-compute[74892]:   <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:36 user nova-compute[74892]:   <nova:ports>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:port uuid="4c90eb33-2bf7-404b-a08e-c268206cdd69">
Nov 15 14:19:36 user nova-compute[74892]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:19:36 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:36 user nova-compute[74892]:     <nova:port uuid="8c8e3c8d-0fec-4955-980b-4ab9ec27e072">
Nov 15 14:19:36 user nova-compute[74892]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Nov 15 14:19:36 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:36 user nova-compute[74892]:   </nova:ports>
Nov 15 14:19:36 user nova-compute[74892]: </nova:instance>
Nov 15 14:19:36 user nova-compute[74892]:   </metadata>
Nov 15 14:19:36 user nova-compute[74892]:   <memory unit='KiB'>524288</memory>
Nov 15 14:19:36 user nova-compute[74892]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 14:19:36 user nova-compute[74892]:   <vcpu placement='static'>1</vcpu>
Nov 15 14:19:36 user nova-compute[74892]:   <resource>
Nov 15 14:19:36 user nova-compute[74892]:     <partition>/machine</partition>
Nov 15 14:19:36 user nova-compute[74892]:   </resource>
Nov 15 14:19:36 user nova-compute[74892]:   <sysinfo type='smbios'>
Nov 15 14:19:36 user nova-compute[74892]:     <system>
Nov 15 14:19:36 user nova-compute[74892]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 14:19:36 user nova-compute[74892]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 14:19:36 user nova-compute[74892]:       <entry name='version'>0.0.0</entry>
Nov 15 14:19:36 user nova-compute[74892]:       <entry name='serial'>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:19:36 user nova-compute[74892]:       <entry name='uuid'>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:19:36 user nova-compute[74892]:       <entry name='family'>Virtual Machine</entry>
Nov 15 14:19:36 user nova-compute[74892]:     </system>
Nov 15 14:19:36 user nova-compute[74892]:   </sysinfo>
Nov 15 14:19:36 user nova-compute[74892]:   <os>
Nov 15 14:19:36 user nova-compute[74892]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 14:19:36 user nova-compute[74892]:     <boot dev='hd'/>
Nov 15 14:19:36 user nova-compute[74892]:     <smbios mode='sysinfo'/>
Nov 15 14:19:36 user nova-compute[74892]:   </os>
Nov 15 14:19:36 user nova-compute[74892]:   <features>
Nov 15 14:19:36 user nova-compute[74892]:     <acpi/>
Nov 15 14:19:36 user nova-compute[74892]:     <apic/>
Nov 15 14:19:36 user nova-compute[74892]:     <vmcoreinfo state='on'/>
Nov 15 14:19:36 user nova-compute[74892]:   </features>
Nov 15 14:19:36 user nova-compute[74892]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 14:19:36 user nova-compute[74892]:     <model fallback='forbid'>Nehalem</model>
Nov 15 14:19:36 user nova-compute[74892]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 14:19:36 user nova-compute[74892]:     <feature policy='require' name='vme'/>
Nov 15 14:19:36 user nova-compute[74892]:     <feature policy='require' name='x2apic'/>
Nov 15 14:19:36 user nova-compute[74892]:     <feature policy='require' name='hypervisor'/>
Nov 15 14:19:36 user nova-compute[74892]:   </cpu>
Nov 15 14:19:36 user nova-compute[74892]:   <clock offset='utc'>
Nov 15 14:19:36 user nova-compute[74892]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 14:19:36 user nova-compute[74892]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 14:19:36 user nova-compute[74892]:     <timer name='hpet' present='no'/>
Nov 15 14:19:36 user nova-compute[74892]:   </clock>
Nov 15 14:19:36 user nova-compute[74892]:   <on_poweroff>destroy</on_poweroff>
Nov 15 14:19:36 user nova-compute[74892]:   <on_reboot>restart</on_reboot>
Nov 15 14:19:36 user nova-compute[74892]:   <on_crash>destroy</on_crash>
Nov 15 14:19:36 user nova-compute[74892]:   <devices>
Nov 15 14:19:36 user nova-compute[74892]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 14:19:36 user nova-compute[74892]:     <disk type='file' device='disk'>
Nov 15 14:19:36 user nova-compute[74892]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 14:19:36 user nova-compute[74892]:       <source file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk' index='2'/>
Nov 15 14:19:36 user nova-compute[74892]:       <backingStore type='file' index='3'>
Nov 15 14:19:36 user nova-compute[74892]:         <format type='raw'/>
Nov 15 14:19:36 user nova-compute[74892]:         <source file='/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e'/>
Nov 15 14:19:36 user nova-compute[74892]:         <backingStore/>
Nov 15 14:19:36 user nova-compute[74892]:       </backingStore>
Nov 15 14:19:36 user nova-compute[74892]:       <target dev='vda' bus='virtio'/>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='virtio-disk0'/>
Nov 15 14:19:36 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </disk>
Nov 15 14:19:36 user nova-compute[74892]:     <disk type='file' device='cdrom'>
Nov 15 14:19:36 user nova-compute[74892]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 14:19:36 user nova-compute[74892]:       <source file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.config' index='1'/>
Nov 15 14:19:36 user nova-compute[74892]:       <backingStore/>
Nov 15 14:19:36 user nova-compute[74892]:       <target dev='hda' bus='ide'/>
Nov 15 14:19:36 user nova-compute[74892]:       <readonly/>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='ide0-0-0'/>
Nov 15 14:19:36 user nova-compute[74892]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </disk>
Nov 15 14:19:36 user nova-compute[74892]:     <controller type='usb' index='0' model='none'>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='usb'/>
Nov 15 14:19:36 user nova-compute[74892]:     </controller>
Nov 15 14:19:36 user nova-compute[74892]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='pci.0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </controller>
Nov 15 14:19:36 user nova-compute[74892]:     <controller type='ide' index='0'>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='ide'/>
Nov 15 14:19:36 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 14:19:36 user nova-compute[74892]:     </controller>
Nov 15 14:19:36 user nova-compute[74892]:     <interface type='ethernet'>
Nov 15 14:19:36 user nova-compute[74892]:       <mac address='fa:16:3e:ba:03:b4'/>
Nov 15 14:19:36 user nova-compute[74892]:       <target dev='tap4c90eb33-2b'/>
Nov 15 14:19:36 user nova-compute[74892]:       <model type='virtio'/>
Nov 15 14:19:36 user nova-compute[74892]:       <mtu size='1442'/>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='net0'/>
Nov 15 14:19:36 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </interface>
Nov 15 14:19:36 user nova-compute[74892]:     <interface type='ethernet'>
Nov 15 14:19:36 user nova-compute[74892]:       <mac address='fa:16:3e:74:64:d0'/>
Nov 15 14:19:36 user nova-compute[74892]:       <target dev='tap8c8e3c8d-0f'/>
Nov 15 14:19:36 user nova-compute[74892]:       <model type='virtio'/>
Nov 15 14:19:36 user nova-compute[74892]:       <mtu size='1442'/>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='net1'/>
Nov 15 14:19:36 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </interface>
Nov 15 14:19:36 user nova-compute[74892]:     <serial type='pty'>
Nov 15 14:19:36 user nova-compute[74892]:       <source path='/dev/pts/6'/>
Nov 15 14:19:36 user nova-compute[74892]:       <log file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log' append='off'/>
Nov 15 14:19:36 user nova-compute[74892]:       <target type='isa-serial' port='0'>
Nov 15 14:19:36 user nova-compute[74892]:         <model name='isa-serial'/>
Nov 15 14:19:36 user nova-compute[74892]:       </target>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='serial0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </serial>
Nov 15 14:19:36 user nova-compute[74892]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 14:19:36 user nova-compute[74892]:       <source path='/dev/pts/6'/>
Nov 15 14:19:36 user nova-compute[74892]:       <log file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log' append='off'/>
Nov 15 14:19:36 user nova-compute[74892]:       <target type='serial' port='0'/>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='serial0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </console>
Nov 15 14:19:36 user nova-compute[74892]:     <input type='mouse' bus='ps2'>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='input0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </input>
Nov 15 14:19:36 user nova-compute[74892]:     <input type='keyboard' bus='ps2'>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='input1'/>
Nov 15 14:19:36 user nova-compute[74892]:     </input>
Nov 15 14:19:36 user nova-compute[74892]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 15 14:19:36 user nova-compute[74892]:       <listen type='address' address='0.0.0.0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </graphics>
Nov 15 14:19:36 user nova-compute[74892]:     <audio id='1' type='none'/>
Nov 15 14:19:36 user nova-compute[74892]:     <video>
Nov 15 14:19:36 user nova-compute[74892]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='video0'/>
Nov 15 14:19:36 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </video>
Nov 15 14:19:36 user nova-compute[74892]:     <memballoon model='virtio'>
Nov 15 14:19:36 user nova-compute[74892]:       <stats period='10'/>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='balloon0'/>
Nov 15 14:19:36 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </memballoon>
Nov 15 14:19:36 user nova-compute[74892]:     <rng model='virtio'>
Nov 15 14:19:36 user nova-compute[74892]:       <backend model='random'>/dev/urandom</backend>
Nov 15 14:19:36 user nova-compute[74892]:       <alias name='rng0'/>
Nov 15 14:19:36 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 14:19:36 user nova-compute[74892]:     </rng>
Nov 15 14:19:36 user nova-compute[74892]:   </devices>
Nov 15 14:19:36 user nova-compute[74892]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 14:19:36 user nova-compute[74892]:     <label>libvirt-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</label>
Nov 15 14:19:36 user nova-compute[74892]:     <imagelabel>libvirt-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</imagelabel>
Nov 15 14:19:36 user nova-compute[74892]:   </seclabel>
Nov 15 14:19:36 user nova-compute[74892]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 14:19:36 user nova-compute[74892]:     <label>+64055:+108</label>
Nov 15 14:19:36 user nova-compute[74892]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 14:19:36 user nova-compute[74892]:   </seclabel>
Nov 15 14:19:36 user nova-compute[74892]: </domain>
Nov 15 14:19:36 user nova-compute[74892]:  {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 14:19:36 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Successfully detached device tap8c8e3c8d-0f from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 from the persistent domain config.
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] (1/8): Attempting to detach device tap8c8e3c8d-0f with device alias net1 from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] detach device xml: <interface type="ethernet">
Nov 15 14:19:36 user nova-compute[74892]:   <mac address="fa:16:3e:74:64:d0"/>
Nov 15 14:19:36 user nova-compute[74892]:   <model type="virtio"/>
Nov 15 14:19:36 user nova-compute[74892]:   <mtu size="1442"/>
Nov 15 14:19:36 user nova-compute[74892]:   <target dev="tap8c8e3c8d-0f"/>
Nov 15 14:19:36 user nova-compute[74892]: </interface>
Nov 15 14:19:36 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Start waiting for the detach event from libvirt for device tap8c8e3c8d-0f with device alias net1 for instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-ffaf642f-08f4-43b4-a6ce-4fe405954905 req-908c8d61-cd46-4efd-9289-556edac49944 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-unplugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ffaf642f-08f4-43b4-a6ce-4fe405954905 req-908c8d61-cd46-4efd-9289-556edac49944 service nova] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ffaf642f-08f4-43b4-a6ce-4fe405954905 req-908c8d61-cd46-4efd-9289-556edac49944 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ffaf642f-08f4-43b4-a6ce-4fe405954905 req-908c8d61-cd46-4efd-9289-556edac49944 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-ffaf642f-08f4-43b4-a6ce-4fe405954905 req-908c8d61-cd46-4efd-9289-556edac49944 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] No waiting events found dispatching network-vif-unplugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:37 user nova-compute[74892]: WARNING nova.compute.manager [req-ffaf642f-08f4-43b4-a6ce-4fe405954905 req-908c8d61-cd46-4efd-9289-556edac49944 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received unexpected event network-vif-unplugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 for instance with vm_state active and task_state None.
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG nova.compute.manager [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ff18e3b-6d7e-40b2-af8e-958c185cd7dd', 'attached_at': '', 'detached_at': '', 'volume_id': '626065b0-844a-47be-b095-5a5f025014e8', 'serial': '626065b0-844a-47be-b095-5a5f025014e8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWvFydnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'd5d8f644-b278-4a2b-9453-e4321892d75f'}, 'status': 'reserved', 'instance': '8ff18e3b-6d7e-40b2-af8e-958c185cd7dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5d8f644-b278-4a2b-9453-e4321892d75f', 'serial'} {{(pid=74892) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:38 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:38 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:38 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: INFO nova.compute.manager [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] [instance: a44f26ed-88ff-486e-929f-141e51009aad] Took 3.19 seconds to detach 3 volumes for instance.
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afe63b0-0fa9-4281-9339-1d23acdba4dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:38 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dad5a8-0427-46d9-ad67-2f251fc64d03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8] added
Nov 15 14:19:38 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b523064c-49c2-48d1-91cf-0ffb2c989331]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b7e01-0eeb-4e72-a9f9-27df9fdf79ce]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PDYRKNto {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PDYRKNto" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d8a9f4-2e61-47f0-854a-24bd2c96edb2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PDYRKNto'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ec671-65a9-431c-b14a-1317445cb145]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d87db8-2fd0-432b-b774-b0765dc3f901]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:38 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:38 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:38 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:38 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:38 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:38 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d034a59-db4b-45dd-a7d0-a2f5d81b1320]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260]
Nov 15 14:19:38 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:38 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a226b199-042d-4e30-a4e7-2489a6e84ba2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6a4fc7-71c6-46a7-958b-260c2db278a5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:39 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:39 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:39 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:39 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:39 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:39 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:39 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:39 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f8fcee-b3da-43f5-ad84-42cda4c7b34c]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-59e5e2d7-4723-44db-93b5-903b589d8cca req-91bb3d6a-8896-416a-96c0-04e9ad800452 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59e5e2d7-4723-44db-93b5-903b589d8cca req-91bb3d6a-8896-416a-96c0-04e9ad800452 service nova] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59e5e2d7-4723-44db-93b5-903b589d8cca req-91bb3d6a-8896-416a-96c0-04e9ad800452 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59e5e2d7-4723-44db-93b5-903b589d8cca req-91bb3d6a-8896-416a-96c0-04e9ad800452 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-59e5e2d7-4723-44db-93b5-903b589d8cca req-91bb3d6a-8896-416a-96c0-04e9ad800452 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] No waiting events found dispatching network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:39 user nova-compute[74892]: WARNING nova.compute.manager [req-59e5e2d7-4723-44db-93b5-903b589d8cca req-91bb3d6a-8896-416a-96c0-04e9ad800452 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received unexpected event network-vif-plugged-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 for instance with vm_state active and task_state None.
Nov 15 14:19:39 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:39 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Deleted allocations for instance a44f26ed-88ff-486e-929f-141e51009aad
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d7b896e6-cb69-45c1-a3c9-5a1b707fcf9f tempest-TaggedBootDevicesTest_v242-512234093 tempest-TaggedBootDevicesTest_v242-512234093-project-member] Lock "a44f26ed-88ff-486e-929f-141e51009aad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.733s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:19:39 user nova-compute[74892]: INFO nova.compute.claims [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Claim successful on node user
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.679s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] <== connect_volume: return (1681ms) {'type': 'block', 'scsi_wwn': '26336313635663236', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336313635663236', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:40 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:19:40 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7478MB free_disk=25.37812042236328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.objects.instance [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lazy-loading 'flavor' on Instance uuid 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.880s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.120s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:19:40 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Creating image(s)
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Ensure instance console log exists: /opt/stack/data/nova/instances/c155e78a-3bb5-46b1-ac34-0bace9450318/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Start _get_guest_xml network_info=[{"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c155e78a-3bb5-46b1-ac34-0bace9450318', 'attached_at': '', 'detached_at': '', 'volume_id': 'f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'serial': 'f2ba5dc0-2823-48ed-98ff-bc471a20f00a'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'a96bbf8d-c26e-41b7-9b65-560212870a05', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:19:40 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 14:19:40 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 14:19:40 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lazy-loading 'vcpu_model' on Instance uuid c155e78a-3bb5-46b1-ac34-0bace9450318 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:40 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:40 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:40 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.policy [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eccd14bd0c974f4a83aba63fd70df073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcc169292ce42fb9f54aab1db3869bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a038db7d-023b-44ac-a74e-be018b0b6492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c155e78a-3bb5-46b1-ac34-0bace9450318 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance f95b420a-69c7-44c0-aba8-0462c1598841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 92b19e94-da7c-4d74-a89a-ea5c709e573c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: INFO nova.virt.block_device [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Booting with blank volume at /dev/vda
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[00259ceb-f216-4bef-8db8-d2e78c6b352e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:40 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d359f2f2-7e90-4dd3-9416-3d4b3fe14e25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a] added
Nov 15 14:19:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a6f6e6-4130-404a-bd06-ec8577560ce4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b69ec0-fa25-4885-b8ee-b39bdd8db82e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v purWlUhz {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v purWlUhz" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfc46fe-27da-4c25-9542-291f70d9e97a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'purWlUhz'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4644fb08-78fa-4fbe-ba2b-4ba96940d6b1]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbe38b1-1495-404f-9bf0-a8c80ccaa64f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[804eb8aa-11bc-4e0e-8a45-096a72a5b59e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260]
Nov 15 14:19:40 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc06b92-ec0d-4c67-aaa3-2fbbe269dddd]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb7e026-7e9f-4945-a76c-9291d839c413]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:40 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:41 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:41 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:41 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:41 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:41 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b6b1af-a676-4d11-88d7-6972ab093d3d]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 152043520 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Successfully created port: d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:19:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 294649856 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23265366265613363', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265366265613363', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1107235037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336786677',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2KiKDdXeNAqvnhWOe4IokiJsPszuyRac/hr6RiPGlUzitCsmqUIxYtGGZBpsS3bdXKowuUuVkKL67IqO63L//BO28Js1mUKMzps/11gW1kNdrY79SZ72XLSRRQSAhs3A==',key_name='tempest-keypair-1595477803',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92bc8d0616234fdf92d29834bda6d906',ramdisk_id='',reservation_id='r-3s6xwekg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-458086644',owner_user_name='tempest-ServerActionsV293TestJSON-458086644-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f2936bf65e4ca3be5b6f81718d8a91',uuid=c155e78a-3bb5-46b1-ac34-0bace9450318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converting VIF {"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:19:42 user nova-compute[74892]:   <uuid>c155e78a-3bb5-46b1-ac34-0bace9450318</uuid>
Nov 15 14:19:42 user nova-compute[74892]:   <name>instance-00000009</name>
Nov 15 14:19:42 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:19:42 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:19:42 user nova-compute[74892]:   <metadata>
Nov 15 14:19:42 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:42 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:19:42 user nova-compute[74892]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1107235037</nova:name>
Nov 15 14:19:42 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:19:40</nova:creationTime>
Nov 15 14:19:42 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:19:42 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:19:42 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:19:42 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:19:42 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:42 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:42 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:19:42 user nova-compute[74892]:       <nova:owner>
Nov 15 14:19:42 user nova-compute[74892]:         <nova:user uuid="92f2936bf65e4ca3be5b6f81718d8a91">tempest-ServerActionsV293TestJSON-458086644-project-member</nova:user>
Nov 15 14:19:42 user nova-compute[74892]:         <nova:project uuid="92bc8d0616234fdf92d29834bda6d906">tempest-ServerActionsV293TestJSON-458086644</nova:project>
Nov 15 14:19:42 user nova-compute[74892]:       </nova:owner>
Nov 15 14:19:42 user nova-compute[74892]:       <nova:ports>
Nov 15 14:19:42 user nova-compute[74892]:         <nova:port uuid="1130e682-747f-499b-9d41-0ed33fd5e873">
Nov 15 14:19:42 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:19:42 user nova-compute[74892]:         </nova:port>
Nov 15 14:19:42 user nova-compute[74892]:       </nova:ports>
Nov 15 14:19:42 user nova-compute[74892]:     </nova:instance>
Nov 15 14:19:42 user nova-compute[74892]:   </metadata>
Nov 15 14:19:42 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:19:42 user nova-compute[74892]:     <system>
Nov 15 14:19:42 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:19:42 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:19:42 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:19:42 user nova-compute[74892]:       <entry name="serial">c155e78a-3bb5-46b1-ac34-0bace9450318</entry>
Nov 15 14:19:42 user nova-compute[74892]:       <entry name="uuid">c155e78a-3bb5-46b1-ac34-0bace9450318</entry>
Nov 15 14:19:42 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:19:42 user nova-compute[74892]:     </system>
Nov 15 14:19:42 user nova-compute[74892]:   </sysinfo>
Nov 15 14:19:42 user nova-compute[74892]:   <os>
Nov 15 14:19:42 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:19:42 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:19:42 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:19:42 user nova-compute[74892]:   </os>
Nov 15 14:19:42 user nova-compute[74892]:   <features>
Nov 15 14:19:42 user nova-compute[74892]:     <acpi/>
Nov 15 14:19:42 user nova-compute[74892]:     <apic/>
Nov 15 14:19:42 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:19:42 user nova-compute[74892]:   </features>
Nov 15 14:19:42 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:19:42 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:19:42 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:19:42 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:19:42 user nova-compute[74892]:   </clock>
Nov 15 14:19:42 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:19:42 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:19:42 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:19:42 user nova-compute[74892]:   </cpu>
Nov 15 14:19:42 user nova-compute[74892]:   <devices>
Nov 15 14:19:42 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:19:42 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:42 user nova-compute[74892]:       <source dev="/dev/sdc"/>
Nov 15 14:19:42 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:19:42 user nova-compute[74892]:       <serial>f2ba5dc0-2823-48ed-98ff-bc471a20f00a</serial>
Nov 15 14:19:42 user nova-compute[74892]:     </disk>
Nov 15 14:19:42 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:19:42 user nova-compute[74892]:       <mac address="fa:16:3e:4c:c7:00"/>
Nov 15 14:19:42 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:19:42 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:19:42 user nova-compute[74892]:       <target dev="tap1130e682-74"/>
Nov 15 14:19:42 user nova-compute[74892]:     </interface>
Nov 15 14:19:42 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:19:42 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/c155e78a-3bb5-46b1-ac34-0bace9450318/console.log" append="off"/>
Nov 15 14:19:42 user nova-compute[74892]:     </serial>
Nov 15 14:19:42 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:19:42 user nova-compute[74892]:     <video>
Nov 15 14:19:42 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:19:42 user nova-compute[74892]:     </video>
Nov 15 14:19:42 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:19:42 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:19:42 user nova-compute[74892]:     </rng>
Nov 15 14:19:42 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:19:42 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:19:42 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:19:42 user nova-compute[74892]:     </memballoon>
Nov 15 14:19:42 user nova-compute[74892]:   </devices>
Nov 15 14:19:42 user nova-compute[74892]: </domain>
Nov 15 14:19:42 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1107235037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336786677',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2KiKDdXeNAqvnhWOe4IokiJsPszuyRac/hr6RiPGlUzitCsmqUIxYtGGZBpsS3bdXKowuUuVkKL67IqO63L//BO28Js1mUKMzps/11gW1kNdrY79SZ72XLSRRQSAhs3A==',key_name='tempest-keypair-1595477803',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='92bc8d0616234fdf92d29834bda6d906',ramdisk_id='',reservation_id='r-3s6xwekg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-458086644',owner_user_name='tempest-ServerActionsV293TestJSON-458086644-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:19:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f2936bf65e4ca3be5b6f81718d8a91',uuid=c155e78a-3bb5-46b1-ac34-0bace9450318,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converting VIF {"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_vif [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7b24285-eaa9-53c0-90f9-c9f1289bb51b', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1130e682-74, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1130e682-74, col_values=(('qos', UUID('1b4ed89b-74c9-4024-bee3-b4f5cb50e592')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1130e682-74, col_values=(('external_ids', {'iface-id': '1130e682-747f-499b-9d41-0ed33fd5e873', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:c7:00', 'vm-uuid': 'c155e78a-3bb5-46b1-ac34-0bace9450318'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:42 user nova-compute[74892]: INFO os_vif [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74')
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] No VIF found with MAC fa:16:3e:4c:c7:00, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 374341632 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Successfully updated port: d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-e74ad648-ccb9-409a-a1b5-262e9fdec064 req-64b5c350-563e-4e6c-a12b-910bf278b0f7 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-changed-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-e74ad648-ccb9-409a-a1b5-262e9fdec064 req-64b5c350-563e-4e6c-a12b-910bf278b0f7 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Refreshing instance network info cache due to event network-changed-d605c970-50ca-4127-bae5-c19aa1a429e0. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e74ad648-ccb9-409a-a1b5-262e9fdec064 req-64b5c350-563e-4e6c-a12b-910bf278b0f7 service nova] Acquiring lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e74ad648-ccb9-409a-a1b5-262e9fdec064 req-64b5c350-563e-4e6c-a12b-910bf278b0f7 service nova] Acquired lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-e74ad648-ccb9-409a-a1b5-262e9fdec064 req-64b5c350-563e-4e6c-a12b-910bf278b0f7 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Refreshing network info cache for port d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:19:42 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 92b19e94-da7c-4d74-a89a-ea5c709e573c is timed out.
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Successfully detached device vdb from instance 92b19e94-da7c-4d74-a89a-ea5c709e573c from the live domain config.
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JZNCWnwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:42 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebc7bfe-b0af-4e45-8ca3-8f1fb98c5ada]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:42 user nova-compute[74892]: No targets found.
Nov 15 14:19:42 user nova-compute[74892]: iSNS:
Nov 15 14:19:42 user nova-compute[74892]: No targets found.
Nov 15 14:19:42 user nova-compute[74892]: STATIC:
Nov 15 14:19:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a
Nov 15 14:19:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:42 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:42 user nova-compute[74892]: No targets found.
Nov 15 14:19:42 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:42 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:42 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-e74ad648-ccb9-409a-a1b5-262e9fdec064 req-64b5c350-563e-4e6c-a12b-910bf278b0f7 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f104db-0f69-4cf6-9d9a-d22103a19050]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[415a9848-40a1-4b92-9792-8097b13f1e42]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:42 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:42 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:42 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:42 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:42 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:42 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:42 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:42 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:42 user nova-compute[74892]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a (non-flash)
Nov 15 14:19:42 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20520ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a'): ({'sdh'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Removing single pathed devices sdh {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e521d4b-71cf-4efe-8058-0ce6c735d273]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b3255b-cba2-45a9-958b-6d616dfb73fd]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Flushing IO for device /dev/sdh {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9145cb-4786-445e-a313-e401f10d6d75]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[add7b4be-a6e2-4583-a91e-b4f7bb061676]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] SCSI volumes sdh have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-e74ad648-ccb9-409a-a1b5-262e9fdec064 req-64b5c350-563e-4e6c-a12b-910bf278b0f7 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e74ad648-ccb9-409a-a1b5-262e9fdec064 req-64b5c350-563e-4e6c-a12b-910bf278b0f7 service nova] Releasing lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquired lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[116e66f6-08a8-4306-b6de-2c8f9a856e75]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 481296384 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2123612-1829-4ae7-b987-e85c5fc795a0]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a, portal: 172.16.0.220,3260]
Nov 15 14:19:42 user nova-compute[74892]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:42 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b640d4c-a7f9-49ea-9813-4910743e777a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6456a0-baad-4f3f-9420-f3181d494ba3]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] <== disconnect_volume: return (401ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating instance_info_cache with network_info: [{"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Releasing lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance network_info: |[{"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 633339904 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updating instance_info_cache with network_info: [{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 766509056 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-0a1e2181-b59b-438a-aedc-e36362c4e71d req-0e986194-9423-4c98-97db-e518bc5b3ddc service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0a1e2181-b59b-438a-aedc-e36362c4e71d req-0e986194-9423-4c98-97db-e518bc5b3ddc service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0a1e2181-b59b-438a-aedc-e36362c4e71d req-0e986194-9423-4c98-97db-e518bc5b3ddc service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0a1e2181-b59b-438a-aedc-e36362c4e71d req-0e986194-9423-4c98-97db-e518bc5b3ddc service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-0a1e2181-b59b-438a-aedc-e36362c4e71d req-0e986194-9423-4c98-97db-e518bc5b3ddc service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] No waiting events found dispatching network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:44 user nova-compute[74892]: WARNING nova.compute.manager [req-0a1e2181-b59b-438a-aedc-e36362c4e71d req-0e986194-9423-4c98-97db-e518bc5b3ddc service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received unexpected event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 14:19:44 user nova-compute[74892]: DEBUG nova.objects.instance [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lazy-loading 'flavor' on Instance uuid 92b19e94-da7c-4d74-a89a-ea5c709e573c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-808bf7d3-c6dd-48b2-94f4-5a1565022456 tempest-VolumesAssistedSnapshotsTest-2001290963 tempest-VolumesAssistedSnapshotsTest-2001290963-project-admin] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.333s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 913309696 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 1009778688 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWvFydnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'd5d8f644-b278-4a2b-9453-e4321892d75f'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:45 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dcbc4d-1a19-4653-9ca7-ecab19732c51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:45 user nova-compute[74892]: No targets found.
Nov 15 14:19:45 user nova-compute[74892]: iSNS:
Nov 15 14:19:45 user nova-compute[74892]: No targets found.
Nov 15 14:19:45 user nova-compute[74892]: STATIC:
Nov 15 14:19:45 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:45 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:45 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:45 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:45 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:45 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:45 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:45 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:45 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:45 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f
Nov 15 14:19:45 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:45 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:45 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:45 user nova-compute[74892]: No targets found.
Nov 15 14:19:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:45 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:45 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eca358-e3cc-4dfd-80f7-8c3af0844972]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d999f7e-b720-4c54-a2cc-63ebfd073170]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:45 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:45 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:45 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f (non-flash)
Nov 15 14:19:45 user nova-compute[74892]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:45 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:45 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20520f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f'): ({'sdj'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Removing single pathed devices sdj {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edc0e31-3b1c-4052-bce2-101ef6806187]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[75101719-30dd-4ede-8782-6ed2a9b60172]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Flushing IO for device /dev/sdj {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.011s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd2e5f6-91ab-4669-b691-2192ca5d641b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb5acad-dd45-4322-8766-eb737260bf69]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] SCSI volumes sdj have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[705ea1a4-acb8-47d9-ad54-daa58afbfd7f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[313d33eb-70ed-42e7-b1e3-d86d139e7942]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f, portal: 172.16.0.220,3260]
Nov 15 14:19:45 user nova-compute[74892]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5d8f644-b278-4a2b-9453-e4321892d75f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80074de-3ef4-4bed-8b20-35730b827dd0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] <== disconnect_volume: return (308ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8ff18e3b-6d7e-40b2-af8e-958c185cd7dd', 'attached_at': '', 'detached_at': '', 'volume_id': '626065b0-844a-47be-b095-5a5f025014e8', 'serial'} {{(pid=74892) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] swap_volume: removing Cinder connection for volume d5d8f644-b278-4a2b-9453-e4321892d75f {{(pid=74892) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-967741b7-860b-483c-bc3c-8eb18902e72f req-ff98edc3-b47e-434a-93cf-4360b7ea5a7b service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-967741b7-860b-483c-bc3c-8eb18902e72f req-ff98edc3-b47e-434a-93cf-4360b7ea5a7b service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-967741b7-860b-483c-bc3c-8eb18902e72f req-ff98edc3-b47e-434a-93cf-4360b7ea5a7b service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-967741b7-860b-483c-bc3c-8eb18902e72f req-ff98edc3-b47e-434a-93cf-4360b7ea5a7b service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-967741b7-860b-483c-bc3c-8eb18902e72f req-ff98edc3-b47e-434a-93cf-4360b7ea5a7b service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] No waiting events found dispatching network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:46 user nova-compute[74892]: WARNING nova.compute.manager [req-967741b7-860b-483c-bc3c-8eb18902e72f req-ff98edc3-b47e-434a-93cf-4360b7ea5a7b service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received unexpected event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 14:19:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:19:46 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance spawned successfully.
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG os_brick.utils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac050221-6f57-436c-af4e-d96de2a9dd43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[858a92b9-c234-4d26-a588-bb36f7f029d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4534882c-08ac-4cbb-8a08-d0310e0d7034]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7351335-be15-4ce5-afee-5172ff174ba9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74892) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 14:19:46 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8274784-d19f-4436-b828-d96a6382cc77]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG os_brick.utils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating existing volume attachment record: f1d21131-9ee7-4336-90d4-0b8edea59f64 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4617d02e-03c1-4906-b928-a71b37e343c8 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] swap_volume: Updating volume d5d8f644-b278-4a2b-9453-e4321892d75f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "PDYRKNto", "auth_password": "boFnBhqR65yHuM", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "626065b0-844a-47be-b095-5a5f025014e8"}, "status": "reserved", "instance": "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd", "attached_at": "", "detached_at": "", "volume_id": "626065b0-844a-47be-b095-5a5f025014e8", "serial": "626065b0-844a-47be-b095-5a5f025014e8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '626065b0-844a-47be-b095-5a5f025014e8', 'no_device': None, 'attachment_id': '71edce5d-7a10-4218-8d58-5ccd8835635a'} {{(pid=74892) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 14:19:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-142b001f-bc88-4a34-8a53-91a42c3c8ade tempest-TestVolumeSwap-1850622417 tempest-TestVolumeSwap-1850622417-project-admin] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.912s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:48 user nova-compute[74892]: INFO nova.compute.manager [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Detaching volume 626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:48 user nova-compute[74892]: INFO nova.virt.block_device [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Attempting to driver detach volume 626065b0-844a-47be-b095-5a5f025014e8 from mountpoint /dev/vdb
Nov 15 14:19:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Attempting to detach device vdb from instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:19:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:48 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:48 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:19:48 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:48 user nova-compute[74892]:   <serial>626065b0-844a-47be-b095-5a5f025014e8</serial>
Nov 15 14:19:48 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:19:48 user nova-compute[74892]: </disk>
Nov 15 14:19:48 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Successfully detached device vdb from instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd from the persistent domain config.
Nov 15 14:19:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:19:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:19:48 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:48 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:19:48 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:19:48 user nova-compute[74892]:   <serial>626065b0-844a-47be-b095-5a5f025014e8</serial>
Nov 15 14:19:48 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:19:48 user nova-compute[74892]: </disk>
Nov 15 14:19:48 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:19:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:19:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance f95b420a-69c7-44c0-aba8-0462c1598841 is timed out.
Nov 15 14:19:49 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Successfully detached device sdc from instance f95b420a-69c7-44c0-aba8-0462c1598841 from the live domain config.
Nov 15 14:19:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyjDBlxH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:49 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b5a2bf-cce4-4da3-8021-2aeb2e4187cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:19:49 user nova-compute[74892]: No targets found.
Nov 15 14:19:49 user nova-compute[74892]: iSNS:
Nov 15 14:19:49 user nova-compute[74892]: No targets found.
Nov 15 14:19:49 user nova-compute[74892]: STATIC:
Nov 15 14:19:49 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668
Nov 15 14:19:49 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:49 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:49 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:19:49 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:49 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:49 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:19:49 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:19:49 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:19:49 user nova-compute[74892]: FIRMWARE:
Nov 15 14:19:49 user nova-compute[74892]: No targets found.
Nov 15 14:19:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:19:49 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:19:49 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39648b3-eee9-42c7-962c-7fee3545b1de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0173e4de-2bb4-4b02-97e5-222102bedc66]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:49 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:49 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 (non-flash)
Nov 15 14:19:49 user nova-compute[74892]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:49 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20562170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668'): ({'sdk'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Removing single pathed devices sdk {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbdda21-c390-4a9b-ac1a-4fb7f3e30bfd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[57072594-ea6f-4a5f-b554-282fc5c8c21c]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Flushing IO for device /dev/sdk {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f7994c-560c-4019-ad7c-4ee0c72ff759]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.049s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bb3425-9f2f-4685-9476-6dfe5d2c4e8e]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] SCSI volumes sdk have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[507957c0-417e-4170-ac9b-f24c6308d97b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fefec9a-36b9-465b-87db-2f955bbc1ea8]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668, portal: 172.16.0.220,3260]
Nov 15 14:19:49 user nova-compute[74892]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b7e99dc-6e21-4a46-ada5-bc42b3ae2668 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d729c5e-1674-43cf-951d-32734bae0b12]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] <== disconnect_volume: return (313ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:19:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lazy-loading 'flavor' on Instance uuid f95b420a-69c7-44c0-aba8-0462c1598841 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d77b5519-4109-41a2-a1c7-a781434475b7 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.269s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:19:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Creating image(s)
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Ensure instance console log exists: /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Start _get_guest_xml network_info=[{"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdsOfZtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8fbd39df-d62a-4d1b-ac46-f0a2503a3987', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'serial': 'a7a39c82-65d7-46bd-a3ce-3ab2523326fe'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'f1d21131-9ee7-4336-90d4-0b8edea59f64', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:19:51 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:19:51 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:19:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdsOfZtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:19:52 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:52 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:19:52 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf2b1cf-270b-4c4b-b338-8fd14eaf894b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:19:52 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[771400e6-e527-47de-aec1-53dd17d39508]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe] added
Nov 15 14:19:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d261ac6-ab25-43fe-97bf-846c766841f8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ed2783-e7a9-4ea3-8686-686140d8ebf3]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdsOfZtL {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdsOfZtL" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acea4f3-1c89-4cc0-9973-b959c0c04701]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdsOfZtL'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[db057644-da47-45db-95e7-8ea0c27bb616]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[649037d2-3f29-47ae-93b0-e85463a56d32]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:52 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:52 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:52 user nova-compute[74892]: INFO nova.compute.manager [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Terminating instance
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23a56e9-2574-4b4e-a80d-7ea7a9d4c70e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe, portal: 172.16.0.220,3260]
Nov 15 14:19:52 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe, portal: 172.16.0.220,3260] successful.
Nov 15 14:19:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9acb63-6651-4b73-83bd-d12502783977]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c750d568-c7a3-4390-8bc1-3f4100d42c5a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:52 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:52 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:19:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:19:52 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:19:52 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:19:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dcbe49-036b-4a14-95a1-c3749c4c9e79]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdsOfZtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-d24747e8-d10f-448f-aae7-aa2d0ed266ea req-ed38bd94-fbdc-48d4-ae44-7e4a3117a14f service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received event network-vif-unplugged-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d24747e8-d10f-448f-aae7-aa2d0ed266ea req-ed38bd94-fbdc-48d4-ae44-7e4a3117a14f service nova] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d24747e8-d10f-448f-aae7-aa2d0ed266ea req-ed38bd94-fbdc-48d4-ae44-7e4a3117a14f service nova] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d24747e8-d10f-448f-aae7-aa2d0ed266ea req-ed38bd94-fbdc-48d4-ae44-7e4a3117a14f service nova] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-d24747e8-d10f-448f-aae7-aa2d0ed266ea req-ed38bd94-fbdc-48d4-ae44-7e4a3117a14f service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] No waiting events found dispatching network-vif-unplugged-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-d24747e8-d10f-448f-aae7-aa2d0ed266ea req-ed38bd94-fbdc-48d4-ae44-7e4a3117a14f service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received event network-vif-unplugged-55f1993f-e400-4ee5-afaf-01695532ac7c for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:19:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Instance destroyed successfully.
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.objects.instance [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lazy-loading 'resources' on Instance uuid f95b420a-69c7-44c0-aba8-0462c1598841 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-761296278',display_name='tempest-AttachSCSIVolumeTestJSON-server-761296278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-761296278',id=10,image_ref='03f466fe-93e2-42a6-9436-442e4411dc78',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdyCkccNt9recQkY0JLdgoDp2gq8GKZ9t91Bhq5aUCfvyG8ozpY2zbMOV58QRmswBmhPx6kT+Y4xlTTtS09jFYRNG3erpMsq6peV2Rdgows+HRcM1Q4TrLU20b0KfEB9A==',key_name='tempest-keypair-559847391',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7eaa91d2ab4f47789867775b10bf2f15',ramdisk_id='',reservation_id='r-01f5ru1y',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='03f466fe-93e2-42a6-9436-442e4411dc78',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2114657185',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2114657185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096eadc3f5844781a9185cceecd152c3',uuid=f95b420a-69c7-44c0-aba8-0462c1598841,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Converting VIF {"id": "55f1993f-e400-4ee5-afaf-01695532ac7c", "address": "fa:16:3e:f0:e7:5a", "network": {"id": "fe6f0686-b87c-4831-b714-679752a10a64", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-823454926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7eaa91d2ab4f47789867775b10bf2f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55f1993f-e4", "ovs_interfaceid": "55f1993f-e400-4ee5-afaf-01695532ac7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e7:5a,bridge_name='br-int',has_traffic_filtering=True,id=55f1993f-e400-4ee5-afaf-01695532ac7c,network=Network(fe6f0686-b87c-4831-b714-679752a10a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f1993f-e4') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG os_vif [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e7:5a,bridge_name='br-int',has_traffic_filtering=True,id=55f1993f-e400-4ee5-afaf-01695532ac7c,network=Network(fe6f0686-b87c-4831-b714-679752a10a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f1993f-e4') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55f1993f-e4, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9ce40d0-5820-4182-9cbf-b240bbc17511) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: INFO os_vif [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e7:5a,bridge_name='br-int',has_traffic_filtering=True,id=55f1993f-e400-4ee5-afaf-01695532ac7c,network=Network(fe6f0686-b87c-4831-b714-679752a10a64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55f1993f-e4')
Nov 15 14:19:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Deleting instance files /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841_del
Nov 15 14:19:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Deletion of /opt/stack/data/nova/instances/f95b420a-69c7-44c0-aba8-0462c1598841_del complete
Nov 15 14:19:53 user nova-compute[74892]: INFO nova.compute.manager [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 14:19:53 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23866366338633664', 'path': '/dev/sdd'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866366338633664', 'path': '/dev/sdd'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670851347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670851347',id=13,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-b2mcwnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:19:41Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=8fbd39df-d62a-4d1b-ac46-f0a2503a3987,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:af,bridge_name='br-int',has_traffic_filtering=True,id=d605c970-50ca-4127-bae5-c19aa1a429e0,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd605c970-50') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.objects.instance [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:19:53 user nova-compute[74892]:   <uuid>8fbd39df-d62a-4d1b-ac46-f0a2503a3987</uuid>
Nov 15 14:19:53 user nova-compute[74892]:   <name>instance-0000000d</name>
Nov 15 14:19:53 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:19:53 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:19:53 user nova-compute[74892]:   <metadata>
Nov 15 14:19:53 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:53 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:19:53 user nova-compute[74892]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1670851347</nova:name>
Nov 15 14:19:53 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:19:51</nova:creationTime>
Nov 15 14:19:53 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:19:53 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:19:53 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:19:53 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:19:53 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:53 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:53 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:19:53 user nova-compute[74892]:       <nova:owner>
Nov 15 14:19:53 user nova-compute[74892]:         <nova:user uuid="eccd14bd0c974f4a83aba63fd70df073">tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member</nova:user>
Nov 15 14:19:53 user nova-compute[74892]:         <nova:project uuid="3fcc169292ce42fb9f54aab1db3869bd">tempest-ServerBootFromVolumeStableRescueTest-760148567</nova:project>
Nov 15 14:19:53 user nova-compute[74892]:       </nova:owner>
Nov 15 14:19:53 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:53 user nova-compute[74892]:       <nova:ports>
Nov 15 14:19:53 user nova-compute[74892]:         <nova:port uuid="d605c970-50ca-4127-bae5-c19aa1a429e0">
Nov 15 14:19:53 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 14:19:53 user nova-compute[74892]:         </nova:port>
Nov 15 14:19:53 user nova-compute[74892]:       </nova:ports>
Nov 15 14:19:53 user nova-compute[74892]:     </nova:instance>
Nov 15 14:19:53 user nova-compute[74892]:   </metadata>
Nov 15 14:19:53 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:19:53 user nova-compute[74892]:     <system>
Nov 15 14:19:53 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:19:53 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:19:53 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:19:53 user nova-compute[74892]:       <entry name="serial">8fbd39df-d62a-4d1b-ac46-f0a2503a3987</entry>
Nov 15 14:19:53 user nova-compute[74892]:       <entry name="uuid">8fbd39df-d62a-4d1b-ac46-f0a2503a3987</entry>
Nov 15 14:19:53 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:19:53 user nova-compute[74892]:     </system>
Nov 15 14:19:53 user nova-compute[74892]:   </sysinfo>
Nov 15 14:19:53 user nova-compute[74892]:   <os>
Nov 15 14:19:53 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:19:53 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:19:53 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:19:53 user nova-compute[74892]:   </os>
Nov 15 14:19:53 user nova-compute[74892]:   <features>
Nov 15 14:19:53 user nova-compute[74892]:     <acpi/>
Nov 15 14:19:53 user nova-compute[74892]:     <apic/>
Nov 15 14:19:53 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:19:53 user nova-compute[74892]:   </features>
Nov 15 14:19:53 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:19:53 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:19:53 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:19:53 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:19:53 user nova-compute[74892]:   </clock>
Nov 15 14:19:53 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:19:53 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:19:53 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:19:53 user nova-compute[74892]:   </cpu>
Nov 15 14:19:53 user nova-compute[74892]:   <devices>
Nov 15 14:19:53 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:19:53 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:19:53 user nova-compute[74892]:       <source dev="/dev/sdd"/>
Nov 15 14:19:53 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:19:53 user nova-compute[74892]:       <serial>a7a39c82-65d7-46bd-a3ce-3ab2523326fe</serial>
Nov 15 14:19:53 user nova-compute[74892]:     </disk>
Nov 15 14:19:53 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:19:53 user nova-compute[74892]:       <mac address="fa:16:3e:1e:a4:af"/>
Nov 15 14:19:53 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:19:53 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:19:53 user nova-compute[74892]:       <target dev="tapd605c970-50"/>
Nov 15 14:19:53 user nova-compute[74892]:     </interface>
Nov 15 14:19:53 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:19:53 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/console.log" append="off"/>
Nov 15 14:19:53 user nova-compute[74892]:     </serial>
Nov 15 14:19:53 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:19:53 user nova-compute[74892]:     <video>
Nov 15 14:19:53 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:19:53 user nova-compute[74892]:     </video>
Nov 15 14:19:53 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:19:53 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:19:53 user nova-compute[74892]:     </rng>
Nov 15 14:19:53 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:19:53 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:19:53 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:19:53 user nova-compute[74892]:     </memballoon>
Nov 15 14:19:53 user nova-compute[74892]:   </devices>
Nov 15 14:19:53 user nova-compute[74892]: </domain>
Nov 15 14:19:53 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670851347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670851347',id=13,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-b2mcwnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:19:41Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=8fbd39df-d62a-4d1b-ac46-f0a2503a3987,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:af,bridge_name='br-int',has_traffic_filtering=True,id=d605c970-50ca-4127-bae5-c19aa1a429e0,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd605c970-50') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG os_vif [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:af,bridge_name='br-int',has_traffic_filtering=True,id=d605c970-50ca-4127-bae5-c19aa1a429e0,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd605c970-50') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '315601c2-1b16-5897-8435-fecf66289901', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd605c970-50, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd605c970-50, col_values=(('qos', UUID('b250448c-9605-4c24-9f3b-f944ff9d2938')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd605c970-50, col_values=(('external_ids', {'iface-id': 'd605c970-50ca-4127-bae5-c19aa1a429e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:a4:af', 'vm-uuid': '8fbd39df-d62a-4d1b-ac46-f0a2503a3987'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:53 user nova-compute[74892]: INFO os_vif [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:a4:af,bridge_name='br-int',has_traffic_filtering=True,id=d605c970-50ca-4127-bae5-c19aa1a429e0,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd605c970-50')
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No VIF found with MAC fa:16:3e:1e:a4:af, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:54 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Took 1.04 seconds to deallocate network for instance.
Nov 15 14:19:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:54 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Deleted allocations for instance f95b420a-69c7-44c0-aba8-0462c1598841
Nov 15 14:19:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8ee26af9-7eab-49b0-b3cb-520a03630177 tempest-AttachSCSIVolumeTestJSON-2114657185 tempest-AttachSCSIVolumeTestJSON-2114657185-project-member] Lock "f95b420a-69c7-44c0-aba8-0462c1598841" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-87ebd468-ed8d-4e1a-aaf2-3348fc4d104e req-64232a49-5585-43ac-b7dc-ff1b5924bdea service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received event network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-87ebd468-ed8d-4e1a-aaf2-3348fc4d104e req-64232a49-5585-43ac-b7dc-ff1b5924bdea service nova] Acquiring lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-87ebd468-ed8d-4e1a-aaf2-3348fc4d104e req-64232a49-5585-43ac-b7dc-ff1b5924bdea service nova] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-87ebd468-ed8d-4e1a-aaf2-3348fc4d104e req-64232a49-5585-43ac-b7dc-ff1b5924bdea service nova] Lock "f95b420a-69c7-44c0-aba8-0462c1598841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-87ebd468-ed8d-4e1a-aaf2-3348fc4d104e req-64232a49-5585-43ac-b7dc-ff1b5924bdea service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] No waiting events found dispatching network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:54 user nova-compute[74892]: WARNING nova.compute.manager [req-87ebd468-ed8d-4e1a-aaf2-3348fc4d104e req-64232a49-5585-43ac-b7dc-ff1b5924bdea service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received unexpected event network-vif-plugged-55f1993f-e400-4ee5-afaf-01695532ac7c for instance with vm_state deleted and task_state None.
Nov 15 14:19:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-87ebd468-ed8d-4e1a-aaf2-3348fc4d104e req-64232a49-5585-43ac-b7dc-ff1b5924bdea service nova] [instance: f95b420a-69c7-44c0-aba8-0462c1598841] Received event network-vif-deleted-55f1993f-e400-4ee5-afaf-01695532ac7c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-6fdead31-2740-493b-a8d5-b2f412f33de4 req-7e6f4ae4-c93c-411d-bbff-0b937b9c2264 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6fdead31-2740-493b-a8d5-b2f412f33de4 req-7e6f4ae4-c93c-411d-bbff-0b937b9c2264 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6fdead31-2740-493b-a8d5-b2f412f33de4 req-7e6f4ae4-c93c-411d-bbff-0b937b9c2264 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6fdead31-2740-493b-a8d5-b2f412f33de4 req-7e6f4ae4-c93c-411d-bbff-0b937b9c2264 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-6fdead31-2740-493b-a8d5-b2f412f33de4 req-7e6f4ae4-c93c-411d-bbff-0b937b9c2264 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:55 user nova-compute[74892]: WARNING nova.compute.manager [req-6fdead31-2740-493b-a8d5-b2f412f33de4 req-7e6f4ae4-c93c-411d-bbff-0b937b9c2264 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state building and task_state spawning.
Nov 15 14:19:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:19:56 user nova-compute[74892]: INFO nova.compute.claims [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Claim successful on node user
Nov 15 14:19:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:19:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance spawned successfully.
Nov 15 14:19:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:19:56 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:19:57 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Waiting for libvirt event about the detach of device tap8c8e3c8d-0f with device alias net1 from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 is timed out.
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface> {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 15 14:19:57 user nova-compute[74892]:   <name>instance-00000007</name>
Nov 15 14:19:57 user nova-compute[74892]:   <uuid>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</uuid>
Nov 15 14:19:57 user nova-compute[74892]:   <metadata>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:57 user nova-compute[74892]:   <nova:package version="0.0.0"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:name>tempest-device-tagging-server-1329550711</nova:name>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:creationTime>2023-11-15 14:19:04</nova:creationTime>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:flavor name="m1.tiny">
Nov 15 14:19:57 user nova-compute[74892]:     <nova:memory>512</nova:memory>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:disk>1</nova:disk>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:swap>0</nova:swap>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:flavor>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:user uuid="096ca6cfce6b437f85f220646f97b902">tempest-TaggedAttachmentsTest-785094056-project-member</nova:user>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:project uuid="446202d935a749749fbba99be6a1d00c">tempest-TaggedAttachmentsTest-785094056</nova:project>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:ports>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:port uuid="4c90eb33-2bf7-404b-a08e-c268206cdd69">
Nov 15 14:19:57 user nova-compute[74892]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:19:57 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:port uuid="8c8e3c8d-0fec-4955-980b-4ab9ec27e072">
Nov 15 14:19:57 user nova-compute[74892]:       <nova:ip type="fixed" address="10.10.10.36" ipVersion="4"/>
Nov 15 14:19:57 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:ports>
Nov 15 14:19:57 user nova-compute[74892]: </nova:instance>
Nov 15 14:19:57 user nova-compute[74892]:   </metadata>
Nov 15 14:19:57 user nova-compute[74892]:   <memory unit='KiB'>524288</memory>
Nov 15 14:19:57 user nova-compute[74892]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 14:19:57 user nova-compute[74892]:   <vcpu placement='static'>1</vcpu>
Nov 15 14:19:57 user nova-compute[74892]:   <resource>
Nov 15 14:19:57 user nova-compute[74892]:     <partition>/machine</partition>
Nov 15 14:19:57 user nova-compute[74892]:   </resource>
Nov 15 14:19:57 user nova-compute[74892]:   <sysinfo type='smbios'>
Nov 15 14:19:57 user nova-compute[74892]:     <system>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='version'>0.0.0</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='serial'>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='uuid'>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='family'>Virtual Machine</entry>
Nov 15 14:19:57 user nova-compute[74892]:     </system>
Nov 15 14:19:57 user nova-compute[74892]:   </sysinfo>
Nov 15 14:19:57 user nova-compute[74892]:   <os>
Nov 15 14:19:57 user nova-compute[74892]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 14:19:57 user nova-compute[74892]:     <boot dev='hd'/>
Nov 15 14:19:57 user nova-compute[74892]:     <smbios mode='sysinfo'/>
Nov 15 14:19:57 user nova-compute[74892]:   </os>
Nov 15 14:19:57 user nova-compute[74892]:   <features>
Nov 15 14:19:57 user nova-compute[74892]:     <acpi/>
Nov 15 14:19:57 user nova-compute[74892]:     <apic/>
Nov 15 14:19:57 user nova-compute[74892]:     <vmcoreinfo state='on'/>
Nov 15 14:19:57 user nova-compute[74892]:   </features>
Nov 15 14:19:57 user nova-compute[74892]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 14:19:57 user nova-compute[74892]:     <model fallback='forbid'>Nehalem</model>
Nov 15 14:19:57 user nova-compute[74892]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='vme'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='x2apic'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='hypervisor'/>
Nov 15 14:19:57 user nova-compute[74892]:   </cpu>
Nov 15 14:19:57 user nova-compute[74892]:   <clock offset='utc'>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='hpet' present='no'/>
Nov 15 14:19:57 user nova-compute[74892]:   </clock>
Nov 15 14:19:57 user nova-compute[74892]:   <on_poweroff>destroy</on_poweroff>
Nov 15 14:19:57 user nova-compute[74892]:   <on_reboot>restart</on_reboot>
Nov 15 14:19:57 user nova-compute[74892]:   <on_crash>destroy</on_crash>
Nov 15 14:19:57 user nova-compute[74892]:   <devices>
Nov 15 14:19:57 user nova-compute[74892]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 14:19:57 user nova-compute[74892]:     <disk type='file' device='disk'>
Nov 15 14:19:57 user nova-compute[74892]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 14:19:57 user nova-compute[74892]:       <source file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk' index='2'/>
Nov 15 14:19:57 user nova-compute[74892]:       <backingStore type='file' index='3'>
Nov 15 14:19:57 user nova-compute[74892]:         <format type='raw'/>
Nov 15 14:19:57 user nova-compute[74892]:         <source file='/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e'/>
Nov 15 14:19:57 user nova-compute[74892]:         <backingStore/>
Nov 15 14:19:57 user nova-compute[74892]:       </backingStore>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='vda' bus='virtio'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='virtio-disk0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </disk>
Nov 15 14:19:57 user nova-compute[74892]:     <disk type='file' device='cdrom'>
Nov 15 14:19:57 user nova-compute[74892]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 14:19:57 user nova-compute[74892]:       <source file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.config' index='1'/>
Nov 15 14:19:57 user nova-compute[74892]:       <backingStore/>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='hda' bus='ide'/>
Nov 15 14:19:57 user nova-compute[74892]:       <readonly/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='ide0-0-0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </disk>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='usb' index='0' model='none'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='usb'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='pci.0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='ide' index='0'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='ide'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <interface type='ethernet'>
Nov 15 14:19:57 user nova-compute[74892]:       <mac address='fa:16:3e:ba:03:b4'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='tap4c90eb33-2b'/>
Nov 15 14:19:57 user nova-compute[74892]:       <model type='virtio'/>
Nov 15 14:19:57 user nova-compute[74892]:       <mtu size='1442'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='net0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </interface>
Nov 15 14:19:57 user nova-compute[74892]:     <serial type='pty'>
Nov 15 14:19:57 user nova-compute[74892]:       <source path='/dev/pts/6'/>
Nov 15 14:19:57 user nova-compute[74892]:       <log file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log' append='off'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target type='isa-serial' port='0'>
Nov 15 14:19:57 user nova-compute[74892]:         <model name='isa-serial'/>
Nov 15 14:19:57 user nova-compute[74892]:       </target>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='serial0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </serial>
Nov 15 14:19:57 user nova-compute[74892]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 14:19:57 user nova-compute[74892]:       <source path='/dev/pts/6'/>
Nov 15 14:19:57 user nova-compute[74892]:       <log file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log' append='off'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target type='serial' port='0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='serial0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </console>
Nov 15 14:19:57 user nova-compute[74892]:     <input type='mouse' bus='ps2'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='input0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </input>
Nov 15 14:19:57 user nova-compute[74892]:     <input type='keyboard' bus='ps2'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='input1'/>
Nov 15 14:19:57 user nova-compute[74892]:     </input>
Nov 15 14:19:57 user nova-compute[74892]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 15 14:19:57 user nova-compute[74892]:       <listen type='address' address='0.0.0.0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </graphics>
Nov 15 14:19:57 user nova-compute[74892]:     <audio id='1' type='none'/>
Nov 15 14:19:57 user nova-compute[74892]:     <video>
Nov 15 14:19:57 user nova-compute[74892]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='video0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </video>
Nov 15 14:19:57 user nova-compute[74892]:     <memballoon model='virtio'>
Nov 15 14:19:57 user nova-compute[74892]:       <stats period='10'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='balloon0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </memballoon>
Nov 15 14:19:57 user nova-compute[74892]:     <rng model='virtio'>
Nov 15 14:19:57 user nova-compute[74892]:       <backend model='random'>/dev/urandom</backend>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='rng0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </rng>
Nov 15 14:19:57 user nova-compute[74892]:   </devices>
Nov 15 14:19:57 user nova-compute[74892]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 14:19:57 user nova-compute[74892]:     <label>libvirt-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</label>
Nov 15 14:19:57 user nova-compute[74892]:     <imagelabel>libvirt-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</imagelabel>
Nov 15 14:19:57 user nova-compute[74892]:   </seclabel>
Nov 15 14:19:57 user nova-compute[74892]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 14:19:57 user nova-compute[74892]:     <label>+64055:+108</label>
Nov 15 14:19:57 user nova-compute[74892]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 14:19:57 user nova-compute[74892]:   </seclabel>
Nov 15 14:19:57 user nova-compute[74892]: </domain>
Nov 15 14:19:57 user nova-compute[74892]:  {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 14:19:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Successfully detached device tap8c8e3c8d-0f from instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 from the live domain config.
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converting VIF {"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG os_vif [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c8e3c8d-0f, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=942cdd98-e3a0-4458-8d05-50a19f779837) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:57 user nova-compute[74892]: INFO os_vif [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f')
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:57 user nova-compute[74892]:   <nova:package version="0.0.0"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:name>tempest-device-tagging-server-1329550711</nova:name>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:creationTime>2023-11-15 14:19:57</nova:creationTime>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:flavor name="m1.tiny">
Nov 15 14:19:57 user nova-compute[74892]:     <nova:memory>512</nova:memory>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:disk>1</nova:disk>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:swap>0</nova:swap>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:flavor>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:user uuid="096ca6cfce6b437f85f220646f97b902">tempest-TaggedAttachmentsTest-785094056-project-member</nova:user>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:project uuid="446202d935a749749fbba99be6a1d00c">tempest-TaggedAttachmentsTest-785094056</nova:project>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:ports>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:port uuid="4c90eb33-2bf7-404b-a08e-c268206cdd69">
Nov 15 14:19:57 user nova-compute[74892]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:19:57 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:ports>
Nov 15 14:19:57 user nova-compute[74892]: </nova:instance>
Nov 15 14:19:57 user nova-compute[74892]:  {{(pid=74892) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:19:57 user nova-compute[74892]: INFO nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-e04fbc4c-4a5e-479b-a929-45f13b1c56c3 req-b768ded8-49e1-4e8a-8394-c25f59f33607 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e04fbc4c-4a5e-479b-a929-45f13b1c56c3 req-b768ded8-49e1-4e8a-8394-c25f59f33607 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e04fbc4c-4a5e-479b-a929-45f13b1c56c3 req-b768ded8-49e1-4e8a-8394-c25f59f33607 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e04fbc4c-4a5e-479b-a929-45f13b1c56c3 req-b768ded8-49e1-4e8a-8394-c25f59f33607 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-e04fbc4c-4a5e-479b-a929-45f13b1c56c3 req-b768ded8-49e1-4e8a-8394-c25f59f33607 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:19:57 user nova-compute[74892]: WARNING nova.compute.manager [req-e04fbc4c-4a5e-479b-a929-45f13b1c56c3 req-b768ded8-49e1-4e8a-8394-c25f59f33607 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state building and task_state spawning.
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:19:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:19:57 user nova-compute[74892]: INFO nova.compute.manager [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Took 17.58 seconds to build instance.
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fc2150af-b0e4-421f-8e4c-b271f8f89420 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.674s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.policy [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99f4ed77744d4cdb80cca826b6dc50b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24aea1db854c42c0aa85018c5518b0a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:19:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Creating image(s)
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "/opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "/opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-deleted-8c8e3c8d-0fec-4955-980b-4ab9ec27e072 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:57 user nova-compute[74892]: INFO nova.compute.manager [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Neutron deleted interface 8c8e3c8d-0fec-4955-980b-4ab9ec27e072; detaching it from the instance and deleting it from the info cache
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquired lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.neutron [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.objects.instance [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Lazy-loading 'system_metadata' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.objects.instance [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Lazy-loading 'flavor' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.235s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.objects.base [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Object Instance<16c1e6b8-fe5d-4a42-b8cb-453b37c88b46> lazy-loaded attributes: system_metadata,flavor {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Converting VIF {"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface> {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Successfully created port: d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 15 14:19:57 user nova-compute[74892]:   <name>instance-00000007</name>
Nov 15 14:19:57 user nova-compute[74892]:   <uuid>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</uuid>
Nov 15 14:19:57 user nova-compute[74892]:   <metadata>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:57 user nova-compute[74892]:   <nova:package version="0.0.0"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:name>tempest-device-tagging-server-1329550711</nova:name>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:creationTime>2023-11-15 14:19:57</nova:creationTime>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:flavor name="m1.tiny">
Nov 15 14:19:57 user nova-compute[74892]:     <nova:memory>512</nova:memory>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:disk>1</nova:disk>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:swap>0</nova:swap>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:flavor>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:user uuid="096ca6cfce6b437f85f220646f97b902">tempest-TaggedAttachmentsTest-785094056-project-member</nova:user>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:project uuid="446202d935a749749fbba99be6a1d00c">tempest-TaggedAttachmentsTest-785094056</nova:project>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:ports>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:port uuid="4c90eb33-2bf7-404b-a08e-c268206cdd69">
Nov 15 14:19:57 user nova-compute[74892]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:19:57 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:ports>
Nov 15 14:19:57 user nova-compute[74892]: </nova:instance>
Nov 15 14:19:57 user nova-compute[74892]:   </metadata>
Nov 15 14:19:57 user nova-compute[74892]:   <memory unit='KiB'>524288</memory>
Nov 15 14:19:57 user nova-compute[74892]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 14:19:57 user nova-compute[74892]:   <vcpu placement='static'>1</vcpu>
Nov 15 14:19:57 user nova-compute[74892]:   <resource>
Nov 15 14:19:57 user nova-compute[74892]:     <partition>/machine</partition>
Nov 15 14:19:57 user nova-compute[74892]:   </resource>
Nov 15 14:19:57 user nova-compute[74892]:   <sysinfo type='smbios'>
Nov 15 14:19:57 user nova-compute[74892]:     <system>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='version'>0.0.0</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='serial'>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='uuid'>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='family'>Virtual Machine</entry>
Nov 15 14:19:57 user nova-compute[74892]:     </system>
Nov 15 14:19:57 user nova-compute[74892]:   </sysinfo>
Nov 15 14:19:57 user nova-compute[74892]:   <os>
Nov 15 14:19:57 user nova-compute[74892]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 14:19:57 user nova-compute[74892]:     <boot dev='hd'/>
Nov 15 14:19:57 user nova-compute[74892]:     <smbios mode='sysinfo'/>
Nov 15 14:19:57 user nova-compute[74892]:   </os>
Nov 15 14:19:57 user nova-compute[74892]:   <features>
Nov 15 14:19:57 user nova-compute[74892]:     <acpi/>
Nov 15 14:19:57 user nova-compute[74892]:     <apic/>
Nov 15 14:19:57 user nova-compute[74892]:     <vmcoreinfo state='on'/>
Nov 15 14:19:57 user nova-compute[74892]:   </features>
Nov 15 14:19:57 user nova-compute[74892]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 14:19:57 user nova-compute[74892]:     <model fallback='forbid'>Nehalem</model>
Nov 15 14:19:57 user nova-compute[74892]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='vme'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='x2apic'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='hypervisor'/>
Nov 15 14:19:57 user nova-compute[74892]:   </cpu>
Nov 15 14:19:57 user nova-compute[74892]:   <clock offset='utc'>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='hpet' present='no'/>
Nov 15 14:19:57 user nova-compute[74892]:   </clock>
Nov 15 14:19:57 user nova-compute[74892]:   <on_poweroff>destroy</on_poweroff>
Nov 15 14:19:57 user nova-compute[74892]:   <on_reboot>restart</on_reboot>
Nov 15 14:19:57 user nova-compute[74892]:   <on_crash>destroy</on_crash>
Nov 15 14:19:57 user nova-compute[74892]:   <devices>
Nov 15 14:19:57 user nova-compute[74892]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 14:19:57 user nova-compute[74892]:     <disk type='file' device='disk'>
Nov 15 14:19:57 user nova-compute[74892]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 14:19:57 user nova-compute[74892]:       <source file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk' index='2'/>
Nov 15 14:19:57 user nova-compute[74892]:       <backingStore type='file' index='3'>
Nov 15 14:19:57 user nova-compute[74892]:         <format type='raw'/>
Nov 15 14:19:57 user nova-compute[74892]:         <source file='/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e'/>
Nov 15 14:19:57 user nova-compute[74892]:         <backingStore/>
Nov 15 14:19:57 user nova-compute[74892]:       </backingStore>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='vda' bus='virtio'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='virtio-disk0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </disk>
Nov 15 14:19:57 user nova-compute[74892]:     <disk type='file' device='cdrom'>
Nov 15 14:19:57 user nova-compute[74892]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 14:19:57 user nova-compute[74892]:       <source file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.config' index='1'/>
Nov 15 14:19:57 user nova-compute[74892]:       <backingStore/>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='hda' bus='ide'/>
Nov 15 14:19:57 user nova-compute[74892]:       <readonly/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='ide0-0-0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </disk>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='usb' index='0' model='none'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='usb'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='pci.0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='ide' index='0'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='ide'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <interface type='ethernet'>
Nov 15 14:19:57 user nova-compute[74892]:       <mac address='fa:16:3e:ba:03:b4'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='tap4c90eb33-2b'/>
Nov 15 14:19:57 user nova-compute[74892]:       <model type='virtio'/>
Nov 15 14:19:57 user nova-compute[74892]:       <mtu size='1442'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='net0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </interface>
Nov 15 14:19:57 user nova-compute[74892]:     <serial type='pty'>
Nov 15 14:19:57 user nova-compute[74892]:       <source path='/dev/pts/6'/>
Nov 15 14:19:57 user nova-compute[74892]:       <log file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log' append='off'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target type='isa-serial' port='0'>
Nov 15 14:19:57 user nova-compute[74892]:         <model name='isa-serial'/>
Nov 15 14:19:57 user nova-compute[74892]:       </target>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='serial0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </serial>
Nov 15 14:19:57 user nova-compute[74892]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 14:19:57 user nova-compute[74892]:       <source path='/dev/pts/6'/>
Nov 15 14:19:57 user nova-compute[74892]:       <log file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log' append='off'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target type='serial' port='0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='serial0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </console>
Nov 15 14:19:57 user nova-compute[74892]:     <input type='mouse' bus='ps2'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='input0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </input>
Nov 15 14:19:57 user nova-compute[74892]:     <input type='keyboard' bus='ps2'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='input1'/>
Nov 15 14:19:57 user nova-compute[74892]:     </input>
Nov 15 14:19:57 user nova-compute[74892]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 15 14:19:57 user nova-compute[74892]:       <listen type='address' address='0.0.0.0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </graphics>
Nov 15 14:19:57 user nova-compute[74892]:     <audio id='1' type='none'/>
Nov 15 14:19:57 user nova-compute[74892]:     <video>
Nov 15 14:19:57 user nova-compute[74892]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='video0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </video>
Nov 15 14:19:57 user nova-compute[74892]:     <memballoon model='virtio'>
Nov 15 14:19:57 user nova-compute[74892]:       <stats period='10'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='balloon0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </memballoon>
Nov 15 14:19:57 user nova-compute[74892]:     <rng model='virtio'>
Nov 15 14:19:57 user nova-compute[74892]:       <backend model='random'>/dev/urandom</backend>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='rng0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </rng>
Nov 15 14:19:57 user nova-compute[74892]:   </devices>
Nov 15 14:19:57 user nova-compute[74892]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 14:19:57 user nova-compute[74892]:     <label>libvirt-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</label>
Nov 15 14:19:57 user nova-compute[74892]:     <imagelabel>libvirt-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</imagelabel>
Nov 15 14:19:57 user nova-compute[74892]:   </seclabel>
Nov 15 14:19:57 user nova-compute[74892]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 14:19:57 user nova-compute[74892]:     <label>+64055:+108</label>
Nov 15 14:19:57 user nova-compute[74892]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 14:19:57 user nova-compute[74892]:   </seclabel>
Nov 15 14:19:57 user nova-compute[74892]: </domain>
Nov 15 14:19:57 user nova-compute[74892]:  {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface> {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:74:64:d0"/><model type="virtio"/><mtu size="1442"/><target dev="tap8c8e3c8d-0f"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 15 14:19:57 user nova-compute[74892]:   <name>instance-00000007</name>
Nov 15 14:19:57 user nova-compute[74892]:   <uuid>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</uuid>
Nov 15 14:19:57 user nova-compute[74892]:   <metadata>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:57 user nova-compute[74892]:   <nova:package version="0.0.0"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:name>tempest-device-tagging-server-1329550711</nova:name>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:creationTime>2023-11-15 14:19:57</nova:creationTime>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:flavor name="m1.tiny">
Nov 15 14:19:57 user nova-compute[74892]:     <nova:memory>512</nova:memory>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:disk>1</nova:disk>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:swap>0</nova:swap>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:flavor>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:user uuid="096ca6cfce6b437f85f220646f97b902">tempest-TaggedAttachmentsTest-785094056-project-member</nova:user>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:project uuid="446202d935a749749fbba99be6a1d00c">tempest-TaggedAttachmentsTest-785094056</nova:project>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:ports>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:port uuid="4c90eb33-2bf7-404b-a08e-c268206cdd69">
Nov 15 14:19:57 user nova-compute[74892]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:19:57 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:ports>
Nov 15 14:19:57 user nova-compute[74892]: </nova:instance>
Nov 15 14:19:57 user nova-compute[74892]:   </metadata>
Nov 15 14:19:57 user nova-compute[74892]:   <memory unit='KiB'>524288</memory>
Nov 15 14:19:57 user nova-compute[74892]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 14:19:57 user nova-compute[74892]:   <vcpu placement='static'>1</vcpu>
Nov 15 14:19:57 user nova-compute[74892]:   <resource>
Nov 15 14:19:57 user nova-compute[74892]:     <partition>/machine</partition>
Nov 15 14:19:57 user nova-compute[74892]:   </resource>
Nov 15 14:19:57 user nova-compute[74892]:   <sysinfo type='smbios'>
Nov 15 14:19:57 user nova-compute[74892]:     <system>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='version'>0.0.0</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='serial'>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='uuid'>16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</entry>
Nov 15 14:19:57 user nova-compute[74892]:       <entry name='family'>Virtual Machine</entry>
Nov 15 14:19:57 user nova-compute[74892]:     </system>
Nov 15 14:19:57 user nova-compute[74892]:   </sysinfo>
Nov 15 14:19:57 user nova-compute[74892]:   <os>
Nov 15 14:19:57 user nova-compute[74892]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 14:19:57 user nova-compute[74892]:     <boot dev='hd'/>
Nov 15 14:19:57 user nova-compute[74892]:     <smbios mode='sysinfo'/>
Nov 15 14:19:57 user nova-compute[74892]:   </os>
Nov 15 14:19:57 user nova-compute[74892]:   <features>
Nov 15 14:19:57 user nova-compute[74892]:     <acpi/>
Nov 15 14:19:57 user nova-compute[74892]:     <apic/>
Nov 15 14:19:57 user nova-compute[74892]:     <vmcoreinfo state='on'/>
Nov 15 14:19:57 user nova-compute[74892]:   </features>
Nov 15 14:19:57 user nova-compute[74892]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 14:19:57 user nova-compute[74892]:     <model fallback='forbid'>Nehalem</model>
Nov 15 14:19:57 user nova-compute[74892]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='vme'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='x2apic'/>
Nov 15 14:19:57 user nova-compute[74892]:     <feature policy='require' name='hypervisor'/>
Nov 15 14:19:57 user nova-compute[74892]:   </cpu>
Nov 15 14:19:57 user nova-compute[74892]:   <clock offset='utc'>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 14:19:57 user nova-compute[74892]:     <timer name='hpet' present='no'/>
Nov 15 14:19:57 user nova-compute[74892]:   </clock>
Nov 15 14:19:57 user nova-compute[74892]:   <on_poweroff>destroy</on_poweroff>
Nov 15 14:19:57 user nova-compute[74892]:   <on_reboot>restart</on_reboot>
Nov 15 14:19:57 user nova-compute[74892]:   <on_crash>destroy</on_crash>
Nov 15 14:19:57 user nova-compute[74892]:   <devices>
Nov 15 14:19:57 user nova-compute[74892]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 14:19:57 user nova-compute[74892]:     <disk type='file' device='disk'>
Nov 15 14:19:57 user nova-compute[74892]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 14:19:57 user nova-compute[74892]:       <source file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk' index='2'/>
Nov 15 14:19:57 user nova-compute[74892]:       <backingStore type='file' index='3'>
Nov 15 14:19:57 user nova-compute[74892]:         <format type='raw'/>
Nov 15 14:19:57 user nova-compute[74892]:         <source file='/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e'/>
Nov 15 14:19:57 user nova-compute[74892]:         <backingStore/>
Nov 15 14:19:57 user nova-compute[74892]:       </backingStore>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='vda' bus='virtio'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='virtio-disk0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </disk>
Nov 15 14:19:57 user nova-compute[74892]:     <disk type='file' device='cdrom'>
Nov 15 14:19:57 user nova-compute[74892]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 14:19:57 user nova-compute[74892]:       <source file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/disk.config' index='1'/>
Nov 15 14:19:57 user nova-compute[74892]:       <backingStore/>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='hda' bus='ide'/>
Nov 15 14:19:57 user nova-compute[74892]:       <readonly/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='ide0-0-0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </disk>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='usb' index='0' model='none'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='usb'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='pci.0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <controller type='ide' index='0'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='ide'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 14:19:57 user nova-compute[74892]:     </controller>
Nov 15 14:19:57 user nova-compute[74892]:     <interface type='ethernet'>
Nov 15 14:19:57 user nova-compute[74892]:       <mac address='fa:16:3e:ba:03:b4'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target dev='tap4c90eb33-2b'/>
Nov 15 14:19:57 user nova-compute[74892]:       <model type='virtio'/>
Nov 15 14:19:57 user nova-compute[74892]:       <mtu size='1442'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='net0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </interface>
Nov 15 14:19:57 user nova-compute[74892]:     <serial type='pty'>
Nov 15 14:19:57 user nova-compute[74892]:       <source path='/dev/pts/6'/>
Nov 15 14:19:57 user nova-compute[74892]:       <log file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log' append='off'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target type='isa-serial' port='0'>
Nov 15 14:19:57 user nova-compute[74892]:         <model name='isa-serial'/>
Nov 15 14:19:57 user nova-compute[74892]:       </target>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='serial0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </serial>
Nov 15 14:19:57 user nova-compute[74892]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 14:19:57 user nova-compute[74892]:       <source path='/dev/pts/6'/>
Nov 15 14:19:57 user nova-compute[74892]:       <log file='/opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46/console.log' append='off'/>
Nov 15 14:19:57 user nova-compute[74892]:       <target type='serial' port='0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='serial0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </console>
Nov 15 14:19:57 user nova-compute[74892]:     <input type='mouse' bus='ps2'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='input0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </input>
Nov 15 14:19:57 user nova-compute[74892]:     <input type='keyboard' bus='ps2'>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='input1'/>
Nov 15 14:19:57 user nova-compute[74892]:     </input>
Nov 15 14:19:57 user nova-compute[74892]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 15 14:19:57 user nova-compute[74892]:       <listen type='address' address='0.0.0.0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </graphics>
Nov 15 14:19:57 user nova-compute[74892]:     <audio id='1' type='none'/>
Nov 15 14:19:57 user nova-compute[74892]:     <video>
Nov 15 14:19:57 user nova-compute[74892]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='video0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </video>
Nov 15 14:19:57 user nova-compute[74892]:     <memballoon model='virtio'>
Nov 15 14:19:57 user nova-compute[74892]:       <stats period='10'/>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='balloon0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </memballoon>
Nov 15 14:19:57 user nova-compute[74892]:     <rng model='virtio'>
Nov 15 14:19:57 user nova-compute[74892]:       <backend model='random'>/dev/urandom</backend>
Nov 15 14:19:57 user nova-compute[74892]:       <alias name='rng0'/>
Nov 15 14:19:57 user nova-compute[74892]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 14:19:57 user nova-compute[74892]:     </rng>
Nov 15 14:19:57 user nova-compute[74892]:   </devices>
Nov 15 14:19:57 user nova-compute[74892]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 14:19:57 user nova-compute[74892]:     <label>libvirt-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</label>
Nov 15 14:19:57 user nova-compute[74892]:     <imagelabel>libvirt-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46</imagelabel>
Nov 15 14:19:57 user nova-compute[74892]:   </seclabel>
Nov 15 14:19:57 user nova-compute[74892]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 14:19:57 user nova-compute[74892]:     <label>+64055:+108</label>
Nov 15 14:19:57 user nova-compute[74892]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 14:19:57 user nova-compute[74892]:   </seclabel>
Nov 15 14:19:57 user nova-compute[74892]: </domain>
Nov 15 14:19:57 user nova-compute[74892]:  {{(pid=74892) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 14:19:57 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Detaching interface fa:16:3e:74:64:d0 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8c8e3c8d-0f' not found.
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Converting VIF {"id": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "address": "fa:16:3e:74:64:d0", "network": {"id": "f0bb764d-4f2f-4a68-ba29-a332206dcfbf", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1097238297", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e3c8d-0f", "ovs_interfaceid": "8c8e3c8d-0fec-4955-980b-4ab9ec27e072", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG os_vif [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c8e3c8d-0f, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:19:57 user nova-compute[74892]: INFO os_vif [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c8e3c8d-0fec-4955-980b-4ab9ec27e072,network=Network(f0bb764d-4f2f-4a68-ba29-a332206dcfbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e3c8d-0f')
Nov 15 14:19:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [req-78746431-dee6-42d2-a9f9-b5dccc17e458 req-2981d143-dab4-4ff7-a974-612069cbf5b8 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:57 user nova-compute[74892]:   <nova:package version="0.0.0"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:name>tempest-device-tagging-server-1329550711</nova:name>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:creationTime>2023-11-15 14:19:57</nova:creationTime>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:flavor name="m1.tiny">
Nov 15 14:19:57 user nova-compute[74892]:     <nova:memory>512</nova:memory>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:disk>1</nova:disk>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:swap>0</nova:swap>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:flavor>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:user uuid="096ca6cfce6b437f85f220646f97b902">tempest-TaggedAttachmentsTest-785094056-project-member</nova:user>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:project uuid="446202d935a749749fbba99be6a1d00c">tempest-TaggedAttachmentsTest-785094056</nova:project>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:owner>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:57 user nova-compute[74892]:   <nova:ports>
Nov 15 14:19:57 user nova-compute[74892]:     <nova:port uuid="4c90eb33-2bf7-404b-a08e-c268206cdd69">
Nov 15 14:19:57 user nova-compute[74892]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:19:57 user nova-compute[74892]:     </nova:port>
Nov 15 14:19:57 user nova-compute[74892]:   </nova:ports>
Nov 15 14:19:57 user nova-compute[74892]: </nova:instance>
Nov 15 14:19:57 user nova-compute[74892]:  {{(pid=74892) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.223s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk 1073741824" returned: 0 in 0.051s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [{"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Releasing lock "refresh_cache-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8b9e5a63-8f43-4eed-8f1f-10566b0d1063 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "interface-16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-8c8e3c8d-0fec-4955-980b-4ab9ec27e072" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.600s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Cannot resize image /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Ensure instance console log exists: /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Successfully updated port: d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "refresh_cache-ce081593-37a3-49bf-9bf0-a9a6f7aba337" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquired lock "refresh_cache-ce081593-37a3-49bf-9bf0-a9a6f7aba337" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Updating instance_info_cache with network_info: [{"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Releasing lock "refresh_cache-ce081593-37a3-49bf-9bf0-a9a6f7aba337" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Instance network_info: |[{"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Start _get_guest_xml network_info=[{"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:19:58 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:19:58 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-373577490',display_name='tempest-VolumesActionsTest-instance-373577490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-373577490',id=14,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24aea1db854c42c0aa85018c5518b0a5',ramdisk_id='',reservation_id='r-tnsn8tho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1307238287',owner_user_name='tempest-VolumesActionsTest-1307238287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:19:57Z,user_data=None,user_id='99f4ed77744d4cdb80cca826b6dc50b9',uuid=ce081593-37a3-49bf-9bf0-a9a6f7aba337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converting VIF {"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:cc:6e,bridge_name='br-int',has_traffic_filtering=True,id=d7b0fae2-b0dc-49ce-b211-464a83f0a5a0,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7b0fae2-b0') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lazy-loading 'pci_devices' on Instance uuid ce081593-37a3-49bf-9bf0-a9a6f7aba337 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:19:58 user nova-compute[74892]:   <uuid>ce081593-37a3-49bf-9bf0-a9a6f7aba337</uuid>
Nov 15 14:19:58 user nova-compute[74892]:   <name>instance-0000000e</name>
Nov 15 14:19:58 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:19:58 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:19:58 user nova-compute[74892]:   <metadata>
Nov 15 14:19:58 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:19:58 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:19:58 user nova-compute[74892]:       <nova:name>tempest-VolumesActionsTest-instance-373577490</nova:name>
Nov 15 14:19:58 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:19:58</nova:creationTime>
Nov 15 14:19:58 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:19:58 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:19:58 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:19:58 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:19:58 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:19:58 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:19:58 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:19:58 user nova-compute[74892]:       <nova:owner>
Nov 15 14:19:58 user nova-compute[74892]:         <nova:user uuid="99f4ed77744d4cdb80cca826b6dc50b9">tempest-VolumesActionsTest-1307238287-project-member</nova:user>
Nov 15 14:19:58 user nova-compute[74892]:         <nova:project uuid="24aea1db854c42c0aa85018c5518b0a5">tempest-VolumesActionsTest-1307238287</nova:project>
Nov 15 14:19:58 user nova-compute[74892]:       </nova:owner>
Nov 15 14:19:58 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:19:58 user nova-compute[74892]:       <nova:ports>
Nov 15 14:19:58 user nova-compute[74892]:         <nova:port uuid="d7b0fae2-b0dc-49ce-b211-464a83f0a5a0">
Nov 15 14:19:58 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:19:58 user nova-compute[74892]:         </nova:port>
Nov 15 14:19:58 user nova-compute[74892]:       </nova:ports>
Nov 15 14:19:58 user nova-compute[74892]:     </nova:instance>
Nov 15 14:19:58 user nova-compute[74892]:   </metadata>
Nov 15 14:19:58 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:19:58 user nova-compute[74892]:     <system>
Nov 15 14:19:58 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:19:58 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:19:58 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:19:58 user nova-compute[74892]:       <entry name="serial">ce081593-37a3-49bf-9bf0-a9a6f7aba337</entry>
Nov 15 14:19:58 user nova-compute[74892]:       <entry name="uuid">ce081593-37a3-49bf-9bf0-a9a6f7aba337</entry>
Nov 15 14:19:58 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:19:58 user nova-compute[74892]:     </system>
Nov 15 14:19:58 user nova-compute[74892]:   </sysinfo>
Nov 15 14:19:58 user nova-compute[74892]:   <os>
Nov 15 14:19:58 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:19:58 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:19:58 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:19:58 user nova-compute[74892]:   </os>
Nov 15 14:19:58 user nova-compute[74892]:   <features>
Nov 15 14:19:58 user nova-compute[74892]:     <acpi/>
Nov 15 14:19:58 user nova-compute[74892]:     <apic/>
Nov 15 14:19:58 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:19:58 user nova-compute[74892]:   </features>
Nov 15 14:19:58 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:19:58 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:19:58 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:19:58 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:19:58 user nova-compute[74892]:   </clock>
Nov 15 14:19:58 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:19:58 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:19:58 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:19:58 user nova-compute[74892]:   </cpu>
Nov 15 14:19:58 user nova-compute[74892]:   <devices>
Nov 15 14:19:58 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:19:58 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:19:58 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk"/>
Nov 15 14:19:58 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:19:58 user nova-compute[74892]:     </disk>
Nov 15 14:19:58 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:19:58 user nova-compute[74892]:       <mac address="fa:16:3e:50:cc:6e"/>
Nov 15 14:19:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:19:58 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:19:58 user nova-compute[74892]:       <target dev="tapd7b0fae2-b0"/>
Nov 15 14:19:58 user nova-compute[74892]:     </interface>
Nov 15 14:19:58 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:19:58 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/console.log" append="off"/>
Nov 15 14:19:58 user nova-compute[74892]:     </serial>
Nov 15 14:19:58 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:19:58 user nova-compute[74892]:     <video>
Nov 15 14:19:58 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:19:58 user nova-compute[74892]:     </video>
Nov 15 14:19:58 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:19:58 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:19:58 user nova-compute[74892]:     </rng>
Nov 15 14:19:58 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:19:58 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:19:58 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:19:58 user nova-compute[74892]:     </memballoon>
Nov 15 14:19:58 user nova-compute[74892]:   </devices>
Nov 15 14:19:58 user nova-compute[74892]: </domain>
Nov 15 14:19:58 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-373577490',display_name='tempest-VolumesActionsTest-instance-373577490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-373577490',id=14,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='24aea1db854c42c0aa85018c5518b0a5',ramdisk_id='',reservation_id='r-tnsn8tho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1307238287',owner_user_name='tempest-VolumesActionsTest-1307238287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:19:57Z,user_data=None,user_id='99f4ed77744d4cdb80cca826b6dc50b9',uuid=ce081593-37a3-49bf-9bf0-a9a6f7aba337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converting VIF {"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:cc:6e,bridge_name='br-int',has_traffic_filtering=True,id=d7b0fae2-b0dc-49ce-b211-464a83f0a5a0,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7b0fae2-b0') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG os_vif [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:cc:6e,bridge_name='br-int',has_traffic_filtering=True,id=d7b0fae2-b0dc-49ce-b211-464a83f0a5a0,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7b0fae2-b0') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ce67f36-4508-5528-a541-3ad36b6133d4', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7b0fae2-b0, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7b0fae2-b0, col_values=(('qos', UUID('8752b16d-8a6d-4c89-878e-817cf55c1368')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7b0fae2-b0, col_values=(('external_ids', {'iface-id': 'd7b0fae2-b0dc-49ce-b211-464a83f0a5a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:cc:6e', 'vm-uuid': 'ce081593-37a3-49bf-9bf0-a9a6f7aba337'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:19:58 user nova-compute[74892]: INFO os_vif [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:cc:6e,bridge_name='br-int',has_traffic_filtering=True,id=d7b0fae2-b0dc-49ce-b211-464a83f0a5a0,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7b0fae2-b0')
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:19:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] No VIF found with MAC fa:16:3e:50:cc:6e, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:19:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-377becf9-9b17-4fa8-8108-d8b29525c169 req-35b12fbf-17dc-47f5-afb2-90b7c72042d8 service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received event network-changed-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:19:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-377becf9-9b17-4fa8-8108-d8b29525c169 req-35b12fbf-17dc-47f5-afb2-90b7c72042d8 service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Refreshing instance network info cache due to event network-changed-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:19:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-377becf9-9b17-4fa8-8108-d8b29525c169 req-35b12fbf-17dc-47f5-afb2-90b7c72042d8 service nova] Acquiring lock "refresh_cache-ce081593-37a3-49bf-9bf0-a9a6f7aba337" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:19:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-377becf9-9b17-4fa8-8108-d8b29525c169 req-35b12fbf-17dc-47f5-afb2-90b7c72042d8 service nova] Acquired lock "refresh_cache-ce081593-37a3-49bf-9bf0-a9a6f7aba337" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:19:59 user nova-compute[74892]: DEBUG nova.network.neutron [req-377becf9-9b17-4fa8-8108-d8b29525c169 req-35b12fbf-17dc-47f5-afb2-90b7c72042d8 service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Refreshing network info cache for port d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:19:59 user nova-compute[74892]: DEBUG nova.network.neutron [req-377becf9-9b17-4fa8-8108-d8b29525c169 req-35b12fbf-17dc-47f5-afb2-90b7c72042d8 service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Updated VIF entry in instance network info cache for port d7b0fae2-b0dc-49ce-b211-464a83f0a5a0. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:19:59 user nova-compute[74892]: DEBUG nova.network.neutron [req-377becf9-9b17-4fa8-8108-d8b29525c169 req-35b12fbf-17dc-47f5-afb2-90b7c72042d8 service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Updating instance_info_cache with network_info: [{"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:19:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-377becf9-9b17-4fa8-8108-d8b29525c169 req-35b12fbf-17dc-47f5-afb2-90b7c72042d8 service nova] Releasing lock "refresh_cache-ce081593-37a3-49bf-9bf0-a9a6f7aba337" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-188d6d9b-4b62-4b96-a788-d84a8163a285 req-399dcb0f-9e96-414c-b8b9-a4a0980c1e7b service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received event network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-188d6d9b-4b62-4b96-a788-d84a8163a285 req-399dcb0f-9e96-414c-b8b9-a4a0980c1e7b service nova] Acquiring lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-188d6d9b-4b62-4b96-a788-d84a8163a285 req-399dcb0f-9e96-414c-b8b9-a4a0980c1e7b service nova] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-188d6d9b-4b62-4b96-a788-d84a8163a285 req-399dcb0f-9e96-414c-b8b9-a4a0980c1e7b service nova] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-188d6d9b-4b62-4b96-a788-d84a8163a285 req-399dcb0f-9e96-414c-b8b9-a4a0980c1e7b service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] No waiting events found dispatching network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:00 user nova-compute[74892]: WARNING nova.compute.manager [req-188d6d9b-4b62-4b96-a788-d84a8163a285 req-399dcb0f-9e96-414c-b8b9-a4a0980c1e7b service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received unexpected event network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 for instance with vm_state building and task_state spawning.
Nov 15 14:20:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:20:00 user nova-compute[74892]: INFO nova.compute.claims [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Claim successful on node user
Nov 15 14:20:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:20:01 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:20:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.policy [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5945249c9efe4a40980557b4aba1d0da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ed8813ce754c82b8abaa69a5e509f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:20:01 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Creating image(s)
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "/opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "/opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "/opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk 1073741824" returned: 0 in 0.101s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Successfully created port: 2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Cannot resize image /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Ensure instance console log exists: /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-e0c898d4-853e-4b3f-b622-3b93115683cb req-568e5135-fc01-4e62-b7f1-8a975fe1e692 service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received event network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e0c898d4-853e-4b3f-b622-3b93115683cb req-568e5135-fc01-4e62-b7f1-8a975fe1e692 service nova] Acquiring lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e0c898d4-853e-4b3f-b622-3b93115683cb req-568e5135-fc01-4e62-b7f1-8a975fe1e692 service nova] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e0c898d4-853e-4b3f-b622-3b93115683cb req-568e5135-fc01-4e62-b7f1-8a975fe1e692 service nova] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-e0c898d4-853e-4b3f-b622-3b93115683cb req-568e5135-fc01-4e62-b7f1-8a975fe1e692 service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] No waiting events found dispatching network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:02 user nova-compute[74892]: WARNING nova.compute.manager [req-e0c898d4-853e-4b3f-b622-3b93115683cb req-568e5135-fc01-4e62-b7f1-8a975fe1e692 service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received unexpected event network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 for instance with vm_state building and task_state spawning.
Nov 15 14:20:02 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Instance spawned successfully.
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.neutron [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Successfully updated port: 2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "refresh_cache-84b93526-cf57-4c07-ac77-9ae6ab68cf01" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquired lock "refresh_cache-84b93526-cf57-4c07-ac77-9ae6ab68cf01" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.neutron [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:20:02 user nova-compute[74892]: INFO nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-638557fc-16d9-4fcf-bc21-ebf2a73948a0 req-fc7ab45a-504d-4ee0-973e-0ad5e2375827 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received event network-changed-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-638557fc-16d9-4fcf-bc21-ebf2a73948a0 req-fc7ab45a-504d-4ee0-973e-0ad5e2375827 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Refreshing instance network info cache due to event network-changed-2f32e4c9-a025-4eca-978a-12792cdec0a5. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-638557fc-16d9-4fcf-bc21-ebf2a73948a0 req-fc7ab45a-504d-4ee0-973e-0ad5e2375827 service nova] Acquiring lock "refresh_cache-84b93526-cf57-4c07-ac77-9ae6ab68cf01" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.neutron [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:20:02 user nova-compute[74892]: INFO nova.compute.manager [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Took 6.18 seconds to build instance.
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca3c651f-ac91-4671-8da4-0f88b4d5790c tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.296s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.neutron [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Updating instance_info_cache with network_info: [{"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Releasing lock "refresh_cache-84b93526-cf57-4c07-ac77-9ae6ab68cf01" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Instance network_info: |[{"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-638557fc-16d9-4fcf-bc21-ebf2a73948a0 req-fc7ab45a-504d-4ee0-973e-0ad5e2375827 service nova] Acquired lock "refresh_cache-84b93526-cf57-4c07-ac77-9ae6ab68cf01" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.neutron [req-638557fc-16d9-4fcf-bc21-ebf2a73948a0 req-fc7ab45a-504d-4ee0-973e-0ad5e2375827 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Refreshing network info cache for port 2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Start _get_guest_xml network_info=[{"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:20:02 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:20:02 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-806146840',display_name='tempest-VolumesAdminNegativeTest-server-806146840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-806146840',id=15,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ed8813ce754c82b8abaa69a5e509f1',ramdisk_id='',reservation_id='r-e81fc13v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1173866799',owner_user_name='tempest-VolumesAdminNegativeTest-1173866799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:01Z,user_data=None,user_id='5945249c9efe4a40980557b4aba1d0da',uuid=84b93526-cf57-4c07-ac77-9ae6ab68cf01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converting VIF {"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:91:5a,bridge_name='br-int',has_traffic_filtering=True,id=2f32e4c9-a025-4eca-978a-12792cdec0a5,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f32e4c9-a0') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.objects.instance [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lazy-loading 'pci_devices' on Instance uuid 84b93526-cf57-4c07-ac77-9ae6ab68cf01 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:20:02 user nova-compute[74892]:   <uuid>84b93526-cf57-4c07-ac77-9ae6ab68cf01</uuid>
Nov 15 14:20:02 user nova-compute[74892]:   <name>instance-0000000f</name>
Nov 15 14:20:02 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:20:02 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:20:02 user nova-compute[74892]:   <metadata>
Nov 15 14:20:02 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:20:02 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:20:02 user nova-compute[74892]:       <nova:name>tempest-VolumesAdminNegativeTest-server-806146840</nova:name>
Nov 15 14:20:02 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:20:02</nova:creationTime>
Nov 15 14:20:02 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:20:02 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:20:02 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:20:02 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:20:02 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:20:02 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:20:02 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:20:02 user nova-compute[74892]:       <nova:owner>
Nov 15 14:20:02 user nova-compute[74892]:         <nova:user uuid="5945249c9efe4a40980557b4aba1d0da">tempest-VolumesAdminNegativeTest-1173866799-project-member</nova:user>
Nov 15 14:20:02 user nova-compute[74892]:         <nova:project uuid="d2ed8813ce754c82b8abaa69a5e509f1">tempest-VolumesAdminNegativeTest-1173866799</nova:project>
Nov 15 14:20:02 user nova-compute[74892]:       </nova:owner>
Nov 15 14:20:02 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:20:02 user nova-compute[74892]:       <nova:ports>
Nov 15 14:20:02 user nova-compute[74892]:         <nova:port uuid="2f32e4c9-a025-4eca-978a-12792cdec0a5">
Nov 15 14:20:02 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 14:20:02 user nova-compute[74892]:         </nova:port>
Nov 15 14:20:02 user nova-compute[74892]:       </nova:ports>
Nov 15 14:20:02 user nova-compute[74892]:     </nova:instance>
Nov 15 14:20:02 user nova-compute[74892]:   </metadata>
Nov 15 14:20:02 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:20:02 user nova-compute[74892]:     <system>
Nov 15 14:20:02 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:20:02 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:20:02 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:20:02 user nova-compute[74892]:       <entry name="serial">84b93526-cf57-4c07-ac77-9ae6ab68cf01</entry>
Nov 15 14:20:02 user nova-compute[74892]:       <entry name="uuid">84b93526-cf57-4c07-ac77-9ae6ab68cf01</entry>
Nov 15 14:20:02 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:20:02 user nova-compute[74892]:     </system>
Nov 15 14:20:02 user nova-compute[74892]:   </sysinfo>
Nov 15 14:20:02 user nova-compute[74892]:   <os>
Nov 15 14:20:02 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:20:02 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:20:02 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:20:02 user nova-compute[74892]:   </os>
Nov 15 14:20:02 user nova-compute[74892]:   <features>
Nov 15 14:20:02 user nova-compute[74892]:     <acpi/>
Nov 15 14:20:02 user nova-compute[74892]:     <apic/>
Nov 15 14:20:02 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:20:02 user nova-compute[74892]:   </features>
Nov 15 14:20:02 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:20:02 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:20:02 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:20:02 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:20:02 user nova-compute[74892]:   </clock>
Nov 15 14:20:02 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:20:02 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:20:02 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:20:02 user nova-compute[74892]:   </cpu>
Nov 15 14:20:02 user nova-compute[74892]:   <devices>
Nov 15 14:20:02 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:20:02 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:20:02 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk"/>
Nov 15 14:20:02 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:20:02 user nova-compute[74892]:     </disk>
Nov 15 14:20:02 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:20:02 user nova-compute[74892]:       <mac address="fa:16:3e:59:91:5a"/>
Nov 15 14:20:02 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:20:02 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:20:02 user nova-compute[74892]:       <target dev="tap2f32e4c9-a0"/>
Nov 15 14:20:02 user nova-compute[74892]:     </interface>
Nov 15 14:20:02 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:20:02 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/console.log" append="off"/>
Nov 15 14:20:02 user nova-compute[74892]:     </serial>
Nov 15 14:20:02 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:20:02 user nova-compute[74892]:     <video>
Nov 15 14:20:02 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:20:02 user nova-compute[74892]:     </video>
Nov 15 14:20:02 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:20:02 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:20:02 user nova-compute[74892]:     </rng>
Nov 15 14:20:02 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:20:02 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:20:02 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:20:02 user nova-compute[74892]:     </memballoon>
Nov 15 14:20:02 user nova-compute[74892]:   </devices>
Nov 15 14:20:02 user nova-compute[74892]: </domain>
Nov 15 14:20:02 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-806146840',display_name='tempest-VolumesAdminNegativeTest-server-806146840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-806146840',id=15,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2ed8813ce754c82b8abaa69a5e509f1',ramdisk_id='',reservation_id='r-e81fc13v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1173866799',owner_user_name='tempest-VolumesAdminNegativeTest-1173866799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:01Z,user_data=None,user_id='5945249c9efe4a40980557b4aba1d0da',uuid=84b93526-cf57-4c07-ac77-9ae6ab68cf01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converting VIF {"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:91:5a,bridge_name='br-int',has_traffic_filtering=True,id=2f32e4c9-a025-4eca-978a-12792cdec0a5,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f32e4c9-a0') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG os_vif [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:91:5a,bridge_name='br-int',has_traffic_filtering=True,id=2f32e4c9-a025-4eca-978a-12792cdec0a5,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f32e4c9-a0') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c22c61f-5c37-5579-ab43-579ac095c4e9', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f32e4c9-a0, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f32e4c9-a0, col_values=(('qos', UUID('a431cd05-266f-4b43-8664-61649d3fc57a')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f32e4c9-a0, col_values=(('external_ids', {'iface-id': '2f32e4c9-a025-4eca-978a-12792cdec0a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:91:5a', 'vm-uuid': '84b93526-cf57-4c07-ac77-9ae6ab68cf01'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:03 user nova-compute[74892]: INFO os_vif [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:91:5a,bridge_name='br-int',has_traffic_filtering=True,id=2f32e4c9-a025-4eca-978a-12792cdec0a5,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f32e4c9-a0')
Nov 15 14:20:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] No VIF found with MAC fa:16:3e:59:91:5a, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-638557fc-16d9-4fcf-bc21-ebf2a73948a0 req-fc7ab45a-504d-4ee0-973e-0ad5e2375827 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Updated VIF entry in instance network info cache for port 2f32e4c9-a025-4eca-978a-12792cdec0a5. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-638557fc-16d9-4fcf-bc21-ebf2a73948a0 req-fc7ab45a-504d-4ee0-973e-0ad5e2375827 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Updating instance_info_cache with network_info: [{"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-638557fc-16d9-4fcf-bc21-ebf2a73948a0 req-fc7ab45a-504d-4ee0-973e-0ad5e2375827 service nova] Releasing lock "refresh_cache-84b93526-cf57-4c07-ac77-9ae6ab68cf01" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-5253dca0-fef1-4a50-92fd-2907e35511f2 req-e4e3d5b8-20ed-4ebb-873b-614357554ab7 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received event network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5253dca0-fef1-4a50-92fd-2907e35511f2 req-e4e3d5b8-20ed-4ebb-873b-614357554ab7 service nova] Acquiring lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5253dca0-fef1-4a50-92fd-2907e35511f2 req-e4e3d5b8-20ed-4ebb-873b-614357554ab7 service nova] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5253dca0-fef1-4a50-92fd-2907e35511f2 req-e4e3d5b8-20ed-4ebb-873b-614357554ab7 service nova] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-5253dca0-fef1-4a50-92fd-2907e35511f2 req-e4e3d5b8-20ed-4ebb-873b-614357554ab7 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] No waiting events found dispatching network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:04 user nova-compute[74892]: WARNING nova.compute.manager [req-5253dca0-fef1-4a50-92fd-2907e35511f2 req-e4e3d5b8-20ed-4ebb-873b-614357554ab7 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received unexpected event network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 for instance with vm_state building and task_state spawning.
Nov 15 14:20:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:20:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Instance spawned successfully.
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:06 user nova-compute[74892]: INFO nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-229931a9-65e0-4ee1-b290-a8228cfd68ba req-e840f0c7-64e3-4e44-adcc-d8658093c396 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received event network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-229931a9-65e0-4ee1-b290-a8228cfd68ba req-e840f0c7-64e3-4e44-adcc-d8658093c396 service nova] Acquiring lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-229931a9-65e0-4ee1-b290-a8228cfd68ba req-e840f0c7-64e3-4e44-adcc-d8658093c396 service nova] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-229931a9-65e0-4ee1-b290-a8228cfd68ba req-e840f0c7-64e3-4e44-adcc-d8658093c396 service nova] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-229931a9-65e0-4ee1-b290-a8228cfd68ba req-e840f0c7-64e3-4e44-adcc-d8658093c396 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] No waiting events found dispatching network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:06 user nova-compute[74892]: WARNING nova.compute.manager [req-229931a9-65e0-4ee1-b290-a8228cfd68ba req-e840f0c7-64e3-4e44-adcc-d8658093c396 service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received unexpected event network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 for instance with vm_state building and task_state spawning.
Nov 15 14:20:06 user nova-compute[74892]: INFO nova.compute.manager [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Took 6.03 seconds to build instance.
Nov 15 14:20:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e65bc21b-a820-4ed6-9802-bb31494a3ca5 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.189s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:08 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd is timed out.
Nov 15 14:20:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Successfully detached device vdb from instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd from the live domain config.
Nov 15 14:20:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PDYRKNto', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '626065b0-844a-47be-b095-5a5f025014e8'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:20:08 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7aa4d9-3b8e-480f-8bad-95df2ab11fce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:20:08 user nova-compute[74892]: No targets found.
Nov 15 14:20:08 user nova-compute[74892]: iSNS:
Nov 15 14:20:08 user nova-compute[74892]: No targets found.
Nov 15 14:20:08 user nova-compute[74892]: STATIC:
Nov 15 14:20:08 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:20:08 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:08 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:08 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:20:08 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:08 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:08 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8
Nov 15 14:20:08 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:08 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:08 user nova-compute[74892]: FIRMWARE:
Nov 15 14:20:08 user nova-compute[74892]: No targets found.
Nov 15 14:20:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:20:08 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:20:08 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b767cf6-b1f5-4aa6-8be4-ae393d2885df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[793b0e9e-d3ca-489c-9972-09160f62cd29]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:20:08 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:08 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 (non-flash)
Nov 15 14:20:08 user nova-compute[74892]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:08 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00614940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3573791d-bd7e-456f-b88c-dbb7194dc572]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7a588a-d0d4-4b3e-8d69-d7ff8231fbec]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[abca6432-8d16-4ec3-90a1-de44820684c8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.122s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[31404f28-d0ac-4df5-b99e-3fbf6d1eda7d]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8bdfb5-2f86-4420-b760-5eb42560a3ae]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4700027d-d170-4a5f-8031-c1e6841740d3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260]
Nov 15 14:20:09 user nova-compute[74892]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:20:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:626065b0-844a-47be-b095-5a5f025014e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c8e8ad-3fae-4e9d-8527-d509a1328291]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] <== disconnect_volume: return (391ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:20:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lazy-loading 'flavor' on Instance uuid 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6925ea3b-d93c-4788-9464-51fcb974919d tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.924s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:14 user nova-compute[74892]: INFO nova.compute.manager [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Terminating instance
Nov 15 14:20:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-85f510f2-eeb2-4189-92ac-c0645c16339a req-365c9ad5-146f-4868-9277-a25b25060890 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received event network-vif-unplugged-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-85f510f2-eeb2-4189-92ac-c0645c16339a req-365c9ad5-146f-4868-9277-a25b25060890 service nova] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-85f510f2-eeb2-4189-92ac-c0645c16339a req-365c9ad5-146f-4868-9277-a25b25060890 service nova] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-85f510f2-eeb2-4189-92ac-c0645c16339a req-365c9ad5-146f-4868-9277-a25b25060890 service nova] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-85f510f2-eeb2-4189-92ac-c0645c16339a req-365c9ad5-146f-4868-9277-a25b25060890 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] No waiting events found dispatching network-vif-unplugged-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-85f510f2-eeb2-4189-92ac-c0645c16339a req-365c9ad5-146f-4868-9277-a25b25060890 service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received event network-vif-unplugged-886325ed-370a-409c-9ffa-281542e4ecae for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:20:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Instance destroyed successfully.
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lazy-loading 'resources' on Instance uuid 92b19e94-da7c-4d74-a89a-ea5c709e573c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-407695004',display_name='tempest-VolumesAssistedSnapshotsTest-server-407695004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-407695004',id=11,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPa/2TyPHb+ApViwH6OCvQfZeyn8up/EsqGlJif4SfyY1cnsGjfa2lp6DHEzQ2SX+8afnSdB7YPbBBN4FqFrAlKO+imtyniCVXRiUyestvDYKlxGeP0nsbSN17UKKyW48A==',key_name='tempest-keypair-130684183',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2e5e6b12fde47ccbd8f966bce629b03',ramdisk_id='',reservation_id='r-nb4eqmvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-318542867',owner_user_name='tempest-VolumesAssistedSnapshotsTest-318542867-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e743ddbc38f640fe8740c34e140abb6d',uuid=92b19e94-da7c-4d74-a89a-ea5c709e573c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Converting VIF {"id": "886325ed-370a-409c-9ffa-281542e4ecae", "address": "fa:16:3e:1a:d3:cc", "network": {"id": "26ae8837-a041-4097-8b89-ff3c120aed86", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1941656928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2e5e6b12fde47ccbd8f966bce629b03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap886325ed-37", "ovs_interfaceid": "886325ed-370a-409c-9ffa-281542e4ecae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=886325ed-370a-409c-9ffa-281542e4ecae,network=Network(26ae8837-a041-4097-8b89-ff3c120aed86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886325ed-37') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG os_vif [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=886325ed-370a-409c-9ffa-281542e4ecae,network=Network(26ae8837-a041-4097-8b89-ff3c120aed86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886325ed-37') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap886325ed-37, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a66b827f-b1f9-4807-92c7-298ff07175f7) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:15 user nova-compute[74892]: INFO os_vif [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:d3:cc,bridge_name='br-int',has_traffic_filtering=True,id=886325ed-370a-409c-9ffa-281542e4ecae,network=Network(26ae8837-a041-4097-8b89-ff3c120aed86),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap886325ed-37')
Nov 15 14:20:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Deleting instance files /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c_del
Nov 15 14:20:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Deletion of /opt/stack/data/nova/instances/92b19e94-da7c-4d74-a89a-ea5c709e573c_del complete
Nov 15 14:20:15 user nova-compute[74892]: INFO nova.compute.manager [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 14:20:15 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:20:15 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:20:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:16 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:16 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Took 1.09 seconds to deallocate network for instance.
Nov 15 14:20:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:17 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:20:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-6d964f5d-5a61-4db3-8df1-2732f1176f15 req-bd2bdbcc-8875-4ec2-96be-570248eac86d service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received event network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6d964f5d-5a61-4db3-8df1-2732f1176f15 req-bd2bdbcc-8875-4ec2-96be-570248eac86d service nova] Acquiring lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6d964f5d-5a61-4db3-8df1-2732f1176f15 req-bd2bdbcc-8875-4ec2-96be-570248eac86d service nova] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6d964f5d-5a61-4db3-8df1-2732f1176f15 req-bd2bdbcc-8875-4ec2-96be-570248eac86d service nova] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-6d964f5d-5a61-4db3-8df1-2732f1176f15 req-bd2bdbcc-8875-4ec2-96be-570248eac86d service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] No waiting events found dispatching network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:17 user nova-compute[74892]: WARNING nova.compute.manager [req-6d964f5d-5a61-4db3-8df1-2732f1176f15 req-bd2bdbcc-8875-4ec2-96be-570248eac86d service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received unexpected event network-vif-plugged-886325ed-370a-409c-9ffa-281542e4ecae for instance with vm_state deleted and task_state None.
Nov 15 14:20:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-6d964f5d-5a61-4db3-8df1-2732f1176f15 req-bd2bdbcc-8875-4ec2-96be-570248eac86d service nova] [instance: 92b19e94-da7c-4d74-a89a-ea5c709e573c] Received event network-vif-deleted-886325ed-370a-409c-9ffa-281542e4ecae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:17 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:20:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:17 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Deleted allocations for instance 92b19e94-da7c-4d74-a89a-ea5c709e573c
Nov 15 14:20:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c923555d-cc1c-4493-8710-90a1c69c9778 tempest-VolumesAssistedSnapshotsTest-318542867 tempest-VolumesAssistedSnapshotsTest-318542867-project-member] Lock "92b19e94-da7c-4d74-a89a-ea5c709e573c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.584s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:27 user nova-compute[74892]: INFO nova.compute.manager [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Terminating instance
Nov 15 14:20:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-63d33517-520c-4a06-910a-7e9f4406385f req-a5b48e23-357c-4d10-be5b-18a3aece7186 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-unplugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-63d33517-520c-4a06-910a-7e9f4406385f req-a5b48e23-357c-4d10-be5b-18a3aece7186 service nova] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-63d33517-520c-4a06-910a-7e9f4406385f req-a5b48e23-357c-4d10-be5b-18a3aece7186 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-63d33517-520c-4a06-910a-7e9f4406385f req-a5b48e23-357c-4d10-be5b-18a3aece7186 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-63d33517-520c-4a06-910a-7e9f4406385f req-a5b48e23-357c-4d10-be5b-18a3aece7186 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] No waiting events found dispatching network-vif-unplugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-63d33517-520c-4a06-910a-7e9f4406385f req-a5b48e23-357c-4d10-be5b-18a3aece7186 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-unplugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:20:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Instance destroyed successfully.
Nov 15 14:20:28 user nova-compute[74892]: DEBUG nova.objects.instance [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lazy-loading 'resources' on Instance uuid 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329550711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1329550711',id=7,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG++yFM7reE+wuhWcQb3+zAVYkhMQooupytnUrCaJWxBsUXPC0OMS+liTfGpiOROG3/GnTLZco6d8Vo1alDeMaH6vZ+86lMmNCkkJcaFEtGCtN79wy7OtYaqJ0nv10VwXQ==',key_name='tempest-keypair-259242604',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='446202d935a749749fbba99be6a1d00c',ramdisk_id='',reservation_id='r-vwfo6r4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-785094056',owner_user_name='tempest-TaggedAttachmentsTest-785094056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='096ca6cfce6b437f85f220646f97b902',uuid=16c1e6b8-fe5d-4a42-b8cb-453b37c88b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converting VIF {"id": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "address": "fa:16:3e:ba:03:b4", "network": {"id": "ad3f36db-6d74-4016-bca0-b9d8394c182e", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1319450576-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "446202d935a749749fbba99be6a1d00c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c90eb33-2b", "ovs_interfaceid": "4c90eb33-2bf7-404b-a08e-c268206cdd69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:03:b4,bridge_name='br-int',has_traffic_filtering=True,id=4c90eb33-2bf7-404b-a08e-c268206cdd69,network=Network(ad3f36db-6d74-4016-bca0-b9d8394c182e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90eb33-2b') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG os_vif [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:03:b4,bridge_name='br-int',has_traffic_filtering=True,id=4c90eb33-2bf7-404b-a08e-c268206cdd69,network=Network(ad3f36db-6d74-4016-bca0-b9d8394c182e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90eb33-2b') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c90eb33-2b, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72af2f58-2cb8-4fff-a6e6-3c49cd042572) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:28 user nova-compute[74892]: INFO os_vif [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:03:b4,bridge_name='br-int',has_traffic_filtering=True,id=4c90eb33-2bf7-404b-a08e-c268206cdd69,network=Network(ad3f36db-6d74-4016-bca0-b9d8394c182e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c90eb33-2b')
Nov 15 14:20:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Deleting instance files /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46_del
Nov 15 14:20:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Deletion of /opt/stack/data/nova/instances/16c1e6b8-fe5d-4a42-b8cb-453b37c88b46_del complete
Nov 15 14:20:28 user nova-compute[74892]: INFO nova.compute.manager [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 15 14:20:28 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:20:28 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:20:29 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:29 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Took 1.45 seconds to deallocate network for instance.
Nov 15 14:20:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-df582d03-09fc-4c98-895c-16dab71f886c req-acf8cf51-cfe8-4bec-9b69-e294ce17cc32 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-deleted-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:29 user nova-compute[74892]: INFO nova.compute.manager [req-df582d03-09fc-4c98-895c-16dab71f886c req-acf8cf51-cfe8-4bec-9b69-e294ce17cc32 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Neutron deleted interface 4c90eb33-2bf7-404b-a08e-c268206cdd69; detaching it from the instance and deleting it from the info cache
Nov 15 14:20:29 user nova-compute[74892]: DEBUG nova.network.neutron [req-df582d03-09fc-4c98-895c-16dab71f886c req-acf8cf51-cfe8-4bec-9b69-e294ce17cc32 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-df582d03-09fc-4c98-895c-16dab71f886c req-acf8cf51-cfe8-4bec-9b69-e294ce17cc32 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Detach interface failed, port_id=4c90eb33-2bf7-404b-a08e-c268206cdd69, reason: Instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:20:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-eb9d0527-ecd8-43ec-84e2-35acc237b8ae req-8500432b-e673-40d6-8932-5745b5662209 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received event network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb9d0527-ecd8-43ec-84e2-35acc237b8ae req-8500432b-e673-40d6-8932-5745b5662209 service nova] Acquiring lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb9d0527-ecd8-43ec-84e2-35acc237b8ae req-8500432b-e673-40d6-8932-5745b5662209 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb9d0527-ecd8-43ec-84e2-35acc237b8ae req-8500432b-e673-40d6-8932-5745b5662209 service nova] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-eb9d0527-ecd8-43ec-84e2-35acc237b8ae req-8500432b-e673-40d6-8932-5745b5662209 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] No waiting events found dispatching network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:29 user nova-compute[74892]: WARNING nova.compute.manager [req-eb9d0527-ecd8-43ec-84e2-35acc237b8ae req-8500432b-e673-40d6-8932-5745b5662209 service nova] [instance: 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46] Received unexpected event network-vif-plugged-4c90eb33-2bf7-404b-a08e-c268206cdd69 for instance with vm_state active and task_state deleting.
Nov 15 14:20:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:30 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:20:30 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:20:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:30 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Deleted allocations for instance 16c1e6b8-fe5d-4a42-b8cb-453b37c88b46
Nov 15 14:20:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dca00536-93bc-48d4-9681-2bfddb5badb0 tempest-TaggedAttachmentsTest-785094056 tempest-TaggedAttachmentsTest-785094056-project-member] Lock "16c1e6b8-fe5d-4a42-b8cb-453b37c88b46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.052s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:20:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG nova.objects.instance [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lazy-loading 'flavor' on Instance uuid 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:37 user nova-compute[74892]: INFO nova.compute.manager [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Attaching volume dc2faf3f-3393-465a-89b4-f7601e07c2e8 to /dev/vdb
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:37 user nova-compute[74892]: DEBUG os_brick.utils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9759dab1-4aa2-40d3-95e6-68711cfa581d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f065e74-77ec-4b5a-9de4-793afa2bfcb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[549c7b87-b864-4f78-9528-ceb0e166bf5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bb99d3-d128-4d1c-b89e-df3680918ac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:20:38 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d38dda2-a235-4571-ab17-8ea546c1653d]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG os_brick.utils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating existing volume attachment record: 8e41789f-63be-4eb6-8eb1-2876556d3f6c {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:38 user nova-compute[74892]: INFO nova.compute.manager [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Terminating instance
Nov 15 14:20:38 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-86c89994-0ed4-4931-af4d-41629c3fa3c1 req-3291b484-ebc3-4990-a4d5-c7c8836185b7 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received event network-vif-unplugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-86c89994-0ed4-4931-af4d-41629c3fa3c1 req-3291b484-ebc3-4990-a4d5-c7c8836185b7 service nova] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-86c89994-0ed4-4931-af4d-41629c3fa3c1 req-3291b484-ebc3-4990-a4d5-c7c8836185b7 service nova] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-86c89994-0ed4-4931-af4d-41629c3fa3c1 req-3291b484-ebc3-4990-a4d5-c7c8836185b7 service nova] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-86c89994-0ed4-4931-af4d-41629c3fa3c1 req-3291b484-ebc3-4990-a4d5-c7c8836185b7 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] No waiting events found dispatching network-vif-unplugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-86c89994-0ed4-4931-af4d-41629c3fa3c1 req-3291b484-ebc3-4990-a4d5-c7c8836185b7 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received event network-vif-unplugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:39 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Instance destroyed successfully.
Nov 15 14:20:39 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lazy-loading 'resources' on Instance uuid 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-934445170',display_name='tempest-TestVolumeSwap-server-934445170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-934445170',id=6,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvoHmttPuvpE3HSVYXIIGpDKqPel41NZ1P8FRt4EarRAjoAQ9HlHFCf5IQ5Rup2xQJQVtxxvHGXhyVnfIuu7QOfV3SMcd9RaxYKKUnBXftxKSmp7VvfFLqe3VNZWgUnIg==',key_name='tempest-keypair-1799138538',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73cb52a070f04d9a88bfbd2d0e1630ac',ramdisk_id='',reservation_id='r-swegoyy7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-157134899',owner_user_name='tempest-TestVolumeSwap-157134899-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff8da0e6ced646b48cf2e8f256421f48',uuid=8ff18e3b-6d7e-40b2-af8e-958c185cd7dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Converting VIF {"id": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "address": "fa:16:3e:ff:aa:d8", "network": {"id": "796b9f2a-c688-42d4-9563-260bd45d0bb6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1107116772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "73cb52a070f04d9a88bfbd2d0e1630ac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5496be4c-9a", "ovs_interfaceid": "5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75,network=Network(796b9f2a-c688-42d4-9563-260bd45d0bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496be4c-9a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG os_vif [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75,network=Network(796b9f2a-c688-42d4-9563-260bd45d0bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496be4c-9a') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5496be4c-9a, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8e17e7a-4e30-438e-beac-3559d44746bb) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:39 user nova-compute[74892]: INFO os_vif [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75,network=Network(796b9f2a-c688-42d4-9563-260bd45d0bb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5496be4c-9a')
Nov 15 14:20:39 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Deleting instance files /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd_del
Nov 15 14:20:39 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Deletion of /opt/stack/data/nova/instances/8ff18e3b-6d7e-40b2-af8e-958c185cd7dd_del complete
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:39 user nova-compute[74892]: INFO nova.compute.manager [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-e97dd3d3-f514-48ad-ba67-88d31a6db492 req-1ca40c43-064d-4986-8221-cc399b4f58fc service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received event network-vif-deleted-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:40 user nova-compute[74892]: INFO nova.compute.manager [req-e97dd3d3-f514-48ad-ba67-88d31a6db492 req-1ca40c43-064d-4986-8221-cc399b4f58fc service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Neutron deleted interface 5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75; detaching it from the instance and deleting it from the info cache
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.network.neutron [req-e97dd3d3-f514-48ad-ba67-88d31a6db492 req-1ca40c43-064d-4986-8221-cc399b4f58fc service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:20:40 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:20:40 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7701MB free_disk=25.376964569091797GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-e97dd3d3-f514-48ad-ba67-88d31a6db492 req-1ca40c43-064d-4986-8221-cc399b4f58fc service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Detach interface failed, port_id=5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75, reason: Instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:20:40 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Took 0.97 seconds to deallocate network for instance.
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a038db7d-023b-44ac-a74e-be018b0b6492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c155e78a-3bb5-46b1-ac34-0bace9450318 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ce081593-37a3-49bf-9bf0-a9a6f7aba337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 84b93526-cf57-4c07-ac77-9ae6ab68cf01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 726e0f64-5808-4e5b-accf-190ed1537b44 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-494dd844-b5ec-424f-a83d-7c8afd1ebf92 req-91954ba5-f603-4388-b598-27db94ae0a84 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received event network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-494dd844-b5ec-424f-a83d-7c8afd1ebf92 req-91954ba5-f603-4388-b598-27db94ae0a84 service nova] Acquiring lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-494dd844-b5ec-424f-a83d-7c8afd1ebf92 req-91954ba5-f603-4388-b598-27db94ae0a84 service nova] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-494dd844-b5ec-424f-a83d-7c8afd1ebf92 req-91954ba5-f603-4388-b598-27db94ae0a84 service nova] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-494dd844-b5ec-424f-a83d-7c8afd1ebf92 req-91954ba5-f603-4388-b598-27db94ae0a84 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] No waiting events found dispatching network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:40 user nova-compute[74892]: WARNING nova.compute.manager [req-494dd844-b5ec-424f-a83d-7c8afd1ebf92 req-91954ba5-f603-4388-b598-27db94ae0a84 service nova] [instance: 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd] Received unexpected event network-vif-plugged-5496be4c-9a7a-4b6b-a7c5-72bbdf4d8b75 for instance with vm_state deleted and task_state None.
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:20:40 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.496s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:20:41 user nova-compute[74892]: INFO nova.compute.claims [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Claim successful on node user
Nov 15 14:20:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.935s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.network.neutron [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.policy [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe166e9b6134abf85db0e21ec1e100d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe544848b48449381967e24f274b7bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:20:41 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:41 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Deleted allocations for instance 8ff18e3b-6d7e-40b2-af8e-958c185cd7dd
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:20:41 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Creating image(s)
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3047126e-e610-4139-b1a3-42610bd2e7a7 tempest-TestVolumeSwap-157134899 tempest-TestVolumeSwap-157134899-project-member] Lock "8ff18e3b-6d7e-40b2-af8e-958c185cd7dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.441s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:42 user nova-compute[74892]: INFO nova.compute.manager [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Unshelving
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: INFO nova.virt.block_device [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Booting with volume d3f5accf-d711-46f6-bf5e-631621cb2b0f at /dev/vdc
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk 1073741824" returned: 0 in 0.053s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG os_brick.utils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[527e589c-a98b-4ec5-a436-dcc31adb4cfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a420e385-cf88-4439-905a-71b1da4581a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e91a5a-d4fe-49f9-8ce4-714409328b99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[115d43b1-9566-47fc-9b01-69a7731a3a9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.203s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:20:42 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd18907-2aa7-454b-a4b7-4852c17d5455]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG os_brick.utils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating existing volume attachment record: 11945a34-7fca-48e7-b251-b82be687a92d {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Successfully created port: 875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Cannot resize image /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Ensure instance console log exists: /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Successfully updated port: 875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquired lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-76c12578-bf14-40bd-a192-2b5082f5dca5 req-15e74390-2d87-411d-8c97-e0c0962efad2 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-changed-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-76c12578-bf14-40bd-a192-2b5082f5dca5 req-15e74390-2d87-411d-8c97-e0c0962efad2 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Refreshing instance network info cache due to event network-changed-875aae3f-fa95-4bf3-8790-42171f0f7fac. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-76c12578-bf14-40bd-a192-2b5082f5dca5 req-15e74390-2d87-411d-8c97-e0c0962efad2 service nova] Acquiring lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Updating instance_info_cache with network_info: [{"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Releasing lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance network_info: |[{"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-76c12578-bf14-40bd-a192-2b5082f5dca5 req-15e74390-2d87-411d-8c97-e0c0962efad2 service nova] Acquired lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.neutron [req-76c12578-bf14-40bd-a192-2b5082f5dca5 req-15e74390-2d87-411d-8c97-e0c0962efad2 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Refreshing network info cache for port 875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Start _get_guest_xml network_info=[{"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:20:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:20:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-564451515',display_name='tempest-tempest.common.compute-instance-564451515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-564451515',id=16,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslINOZ2Yol005NIBUtitD9XCJI8RmHPHYUS8gMfH34ivLR6lUVp5HyfScCUSAKd+rmzUMD/uj5+fomrFGbop1y6YKyOzsM5Zmm+KMHhghi9NTsel0jkmy7KtNQMxeqjQ==',key_name='tempest-keypair-37804521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-720g3l5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=726e0f64-5808-4e5b-accf-190ed1537b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.objects.instance [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'pci_devices' on Instance uuid 726e0f64-5808-4e5b-accf-190ed1537b44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:20:43 user nova-compute[74892]:   <uuid>726e0f64-5808-4e5b-accf-190ed1537b44</uuid>
Nov 15 14:20:43 user nova-compute[74892]:   <name>instance-00000010</name>
Nov 15 14:20:43 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:20:43 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:20:43 user nova-compute[74892]:   <metadata>
Nov 15 14:20:43 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:20:43 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:20:43 user nova-compute[74892]:       <nova:name>tempest-tempest.common.compute-instance-564451515</nova:name>
Nov 15 14:20:43 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:20:43</nova:creationTime>
Nov 15 14:20:43 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:20:43 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:20:43 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:20:43 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:20:43 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:20:43 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:20:43 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:20:43 user nova-compute[74892]:       <nova:owner>
Nov 15 14:20:43 user nova-compute[74892]:         <nova:user uuid="abe166e9b6134abf85db0e21ec1e100d">tempest-ServerActionsTestOtherA-2044893964-project-member</nova:user>
Nov 15 14:20:43 user nova-compute[74892]:         <nova:project uuid="bbe544848b48449381967e24f274b7bd">tempest-ServerActionsTestOtherA-2044893964</nova:project>
Nov 15 14:20:43 user nova-compute[74892]:       </nova:owner>
Nov 15 14:20:43 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:20:43 user nova-compute[74892]:       <nova:ports>
Nov 15 14:20:43 user nova-compute[74892]:         <nova:port uuid="875aae3f-fa95-4bf3-8790-42171f0f7fac">
Nov 15 14:20:43 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 14:20:43 user nova-compute[74892]:         </nova:port>
Nov 15 14:20:43 user nova-compute[74892]:       </nova:ports>
Nov 15 14:20:43 user nova-compute[74892]:     </nova:instance>
Nov 15 14:20:43 user nova-compute[74892]:   </metadata>
Nov 15 14:20:43 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:20:43 user nova-compute[74892]:     <system>
Nov 15 14:20:43 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:20:43 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:20:43 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:20:43 user nova-compute[74892]:       <entry name="serial">726e0f64-5808-4e5b-accf-190ed1537b44</entry>
Nov 15 14:20:43 user nova-compute[74892]:       <entry name="uuid">726e0f64-5808-4e5b-accf-190ed1537b44</entry>
Nov 15 14:20:43 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:20:43 user nova-compute[74892]:     </system>
Nov 15 14:20:43 user nova-compute[74892]:   </sysinfo>
Nov 15 14:20:43 user nova-compute[74892]:   <os>
Nov 15 14:20:43 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:20:43 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:20:43 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:20:43 user nova-compute[74892]:   </os>
Nov 15 14:20:43 user nova-compute[74892]:   <features>
Nov 15 14:20:43 user nova-compute[74892]:     <acpi/>
Nov 15 14:20:43 user nova-compute[74892]:     <apic/>
Nov 15 14:20:43 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:20:43 user nova-compute[74892]:   </features>
Nov 15 14:20:43 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:20:43 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:20:43 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:20:43 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:20:43 user nova-compute[74892]:   </clock>
Nov 15 14:20:43 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:20:43 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:20:43 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:20:43 user nova-compute[74892]:   </cpu>
Nov 15 14:20:43 user nova-compute[74892]:   <devices>
Nov 15 14:20:43 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:20:43 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:20:43 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk"/>
Nov 15 14:20:43 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:20:43 user nova-compute[74892]:     </disk>
Nov 15 14:20:43 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:20:43 user nova-compute[74892]:       <mac address="fa:16:3e:e3:f1:9d"/>
Nov 15 14:20:43 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:20:43 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:20:43 user nova-compute[74892]:       <target dev="tap875aae3f-fa"/>
Nov 15 14:20:43 user nova-compute[74892]:     </interface>
Nov 15 14:20:43 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:20:43 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/console.log" append="off"/>
Nov 15 14:20:43 user nova-compute[74892]:     </serial>
Nov 15 14:20:43 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:20:43 user nova-compute[74892]:     <video>
Nov 15 14:20:43 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:20:43 user nova-compute[74892]:     </video>
Nov 15 14:20:43 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:20:43 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:20:43 user nova-compute[74892]:     </rng>
Nov 15 14:20:43 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:20:43 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:20:43 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:20:43 user nova-compute[74892]:     </memballoon>
Nov 15 14:20:43 user nova-compute[74892]:   </devices>
Nov 15 14:20:43 user nova-compute[74892]: </domain>
Nov 15 14:20:43 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-564451515',display_name='tempest-tempest.common.compute-instance-564451515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-564451515',id=16,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslINOZ2Yol005NIBUtitD9XCJI8RmHPHYUS8gMfH34ivLR6lUVp5HyfScCUSAKd+rmzUMD/uj5+fomrFGbop1y6YKyOzsM5Zmm+KMHhghi9NTsel0jkmy7KtNQMxeqjQ==',key_name='tempest-keypair-37804521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-720g3l5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=726e0f64-5808-4e5b-accf-190ed1537b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG os_vif [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4193e089-efec-5b09-9c96-a1248a86e9c6', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap875aae3f-fa, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap875aae3f-fa, col_values=(('qos', UUID('a465fd94-2941-42f2-bd7b-43dc17cdfd2f')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap875aae3f-fa, col_values=(('external_ids', {'iface-id': '875aae3f-fa95-4bf3-8790-42171f0f7fac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:f1:9d', 'vm-uuid': '726e0f64-5808-4e5b-accf-190ed1537b44'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:43 user nova-compute[74892]: INFO os_vif [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa')
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No VIF found with MAC fa:16:3e:e3:f1:9d, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-76c12578-bf14-40bd-a192-2b5082f5dca5 req-15e74390-2d87-411d-8c97-e0c0962efad2 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Updated VIF entry in instance network info cache for port 875aae3f-fa95-4bf3-8790-42171f0f7fac. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-76c12578-bf14-40bd-a192-2b5082f5dca5 req-15e74390-2d87-411d-8c97-e0c0962efad2 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Updating instance_info_cache with network_info: [{"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-76c12578-bf14-40bd-a192-2b5082f5dca5 req-15e74390-2d87-411d-8c97-e0c0962efad2 service nova] Releasing lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updating instance_info_cache with network_info: [{"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-a038db7d-023b-44ac-a74e-be018b0b6492" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-90ee67ca-0b39-4943-943f-c38ff012be5a req-ad20b20f-17cd-440c-b6b7-279947065490 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-90ee67ca-0b39-4943-943f-c38ff012be5a req-ad20b20f-17cd-440c-b6b7-279947065490 service nova] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-90ee67ca-0b39-4943-943f-c38ff012be5a req-ad20b20f-17cd-440c-b6b7-279947065490 service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-90ee67ca-0b39-4943-943f-c38ff012be5a req-ad20b20f-17cd-440c-b6b7-279947065490 service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-90ee67ca-0b39-4943-943f-c38ff012be5a req-ad20b20f-17cd-440c-b6b7-279947065490 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] No waiting events found dispatching network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:45 user nova-compute[74892]: WARNING nova.compute.manager [req-90ee67ca-0b39-4943-943f-c38ff012be5a req-ad20b20f-17cd-440c-b6b7-279947065490 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received unexpected event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac for instance with vm_state building and task_state spawning.
Nov 15 14:20:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:20:47 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance spawned successfully.
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:20:47 user nova-compute[74892]: INFO nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-45fb8f2f-1b7e-448e-b18a-51f30c1ba41d req-5bcfe1a8-d45a-4577-99f7-5218e77aa9b3 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-45fb8f2f-1b7e-448e-b18a-51f30c1ba41d req-5bcfe1a8-d45a-4577-99f7-5218e77aa9b3 service nova] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-45fb8f2f-1b7e-448e-b18a-51f30c1ba41d req-5bcfe1a8-d45a-4577-99f7-5218e77aa9b3 service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-45fb8f2f-1b7e-448e-b18a-51f30c1ba41d req-5bcfe1a8-d45a-4577-99f7-5218e77aa9b3 service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-45fb8f2f-1b7e-448e-b18a-51f30c1ba41d req-5bcfe1a8-d45a-4577-99f7-5218e77aa9b3 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] No waiting events found dispatching network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:47 user nova-compute[74892]: WARNING nova.compute.manager [req-45fb8f2f-1b7e-448e-b18a-51f30c1ba41d req-5bcfe1a8-d45a-4577-99f7-5218e77aa9b3 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received unexpected event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac for instance with vm_state building and task_state spawning.
Nov 15 14:20:47 user nova-compute[74892]: INFO nova.compute.manager [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Took 7.37 seconds to build instance.
Nov 15 14:20:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-376d0f01-2903-4df7-86a6-6e113646aa7b tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.512s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:20:48 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:20:48 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:20:48 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2cf684-91b5-4e53-a8a7-326caf2dde14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:20:48 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[297af852-32af-4e5f-b0a6-33ec89c85a36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8] added
Nov 15 14:20:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[56631247-7e74-4c4f-ae4c-19ce947e9042]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd4a0b-dc14-492a-add5-05fe6e242454]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yihUezAH {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yihUezAH" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[148aeae5-447d-4649-926c-ff956c1f37bf]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yihUezAH'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7146e2d-7bb1-4ede-97d8-7e6793d2e6ef]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'pci_requests' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'numa_topology' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5804f526-74b3-437d-a5fa-0889236d2ee2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:48 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:48 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:20:48 user nova-compute[74892]: INFO nova.compute.claims [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Claim successful on node user
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4cb085-675e-4cc8-be93-f5e8e7e71f63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]
Nov 15 14:20:48 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:20:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6392aec3-85bc-4ec7-a5d1-a7770960b633]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90e17ed-d001-4103-9757-f36993d29051]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:48 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:48 user nova-compute[74892]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:20:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:48 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:48 user nova-compute[74892]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:20:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d33a016-3f5e-4b6b-8151-b496b85495b8]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:49 user nova-compute[74892]: INFO nova.network.neutron [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating port 571e109b-b616-4b07-84af-97aac4371356 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquired lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26461373031623838', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461373031623838', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG nova.objects.instance [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lazy-loading 'flavor' on Instance uuid 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:20:49 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:20:49 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:20:49 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:20:49 user nova-compute[74892]:   <serial>dc2faf3f-3393-465a-89b4-f7601e07c2e8</serial>
Nov 15 14:20:49 user nova-compute[74892]: </disk>
Nov 15 14:20:49 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-9346cff8-1d6a-41cf-a58c-99af41467e16 req-562f4302-a684-49a0-80bd-825abd7689a1 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-changed-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-9346cff8-1d6a-41cf-a58c-99af41467e16 req-562f4302-a684-49a0-80bd-825abd7689a1 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Refreshing instance network info cache due to event network-changed-571e109b-b616-4b07-84af-97aac4371356. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:20:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9346cff8-1d6a-41cf-a58c-99af41467e16 req-562f4302-a684-49a0-80bd-825abd7689a1 service nova] Acquiring lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] No VIF found with MAC fa:16:3e:3d:a8:cd, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating instance_info_cache with network_info: [{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Releasing lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:20:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Creating image(s)
Nov 15 14:20:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'trusted_certs' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04e66428-c6f4-4931-92ec-f705afa89f0a tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.350s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9346cff8-1d6a-41cf-a58c-99af41467e16 req-562f4302-a684-49a0-80bd-825abd7689a1 service nova] Acquired lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG nova.network.neutron [req-9346cff8-1d6a-41cf-a58c-99af41467e16 req-562f4302-a684-49a0-80bd-825abd7689a1 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Refreshing network info cache for port 571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG nova.objects.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<ffa60aac-02a4-42ab-b97b-b9cc56079e44> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "ce8aa6149197ab116a29f8b6c3059009603b2e4b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ce8aa6149197ab116a29f8b6c3059009603b2e4b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.099s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG nova.virt.images [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] 363aace8-2c2f-4e78-a444-1dfec4b36add was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b.part /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG nova.network.neutron [req-9346cff8-1d6a-41cf-a58c-99af41467e16 req-562f4302-a684-49a0-80bd-825abd7689a1 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updated VIF entry in instance network info cache for port 571e109b-b616-4b07-84af-97aac4371356. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG nova.network.neutron [req-9346cff8-1d6a-41cf-a58c-99af41467e16 req-562f4302-a684-49a0-80bd-825abd7689a1 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating instance_info_cache with network_info: [{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b.part /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b.converted" returned: 0 in 0.220s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9346cff8-1d6a-41cf-a58c-99af41467e16 req-562f4302-a684-49a0-80bd-825abd7689a1 service nova] Releasing lock "refresh_cache-ffa60aac-02a4-42ab-b97b-b9cc56079e44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ce8aa6149197ab116a29f8b6c3059009603b2e4b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.566s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b --force-share --output=json" returned: 0 in 0.196s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "ce8aa6149197ab116a29f8b6c3059009603b2e4b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ce8aa6149197ab116a29f8b6c3059009603b2e4b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b,backing_fmt=raw /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b,backing_fmt=raw /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk 1073741824" returned: 0 in 0.053s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ce8aa6149197ab116a29f8b6c3059009603b2e4b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'migration_context' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG nova.objects.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<ffa60aac-02a4-42ab-b97b-b9cc56079e44> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:20:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Rebasing disk image.
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Stashing vm_state: active {{(pid=74892) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e -F raw /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:52 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:20:52 user nova-compute[74892]: INFO nova.compute.claims [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Claim successful on node user
Nov 15 14:20:53 user nova-compute[74892]: INFO nova.compute.resource_tracker [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating resource usage from migration e4805810-9284-482a-b3c2-8dd87bbad9a9
Nov 15 14:20:53 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:20:53 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:20:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.539s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:53 user nova-compute[74892]: INFO nova.compute.manager [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Migrating
Nov 15 14:20:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:53 user nova-compute[74892]: INFO nova.compute.rpcapi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 14:20:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:20:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Starting migrate_disk_and_power_off {{(pid=74892) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-67d562cb-5b2e-4379-b7c4-946278bf257f req-9ec3bfd7-4197-4fc3-977f-1cdb20d92aa1 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-67d562cb-5b2e-4379-b7c4-946278bf257f req-9ec3bfd7-4197-4fc3-977f-1cdb20d92aa1 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-67d562cb-5b2e-4379-b7c4-946278bf257f req-9ec3bfd7-4197-4fc3-977f-1cdb20d92aa1 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-67d562cb-5b2e-4379-b7c4-946278bf257f req-9ec3bfd7-4197-4fc3-977f-1cdb20d92aa1 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-67d562cb-5b2e-4379-b7c4-946278bf257f req-9ec3bfd7-4197-4fc3-977f-1cdb20d92aa1 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:54 user nova-compute[74892]: WARNING nova.compute.manager [req-67d562cb-5b2e-4379-b7c4-946278bf257f req-9ec3bfd7-4197-4fc3-977f-1cdb20d92aa1 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state active and task_state resize_migrating.
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e -F raw /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk" returned: 0 in 2.217s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Ensure instance console log exists: /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Start _get_guest_xml network_info=[{"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='717796622a65e3a485da046d3d94bc41',container_format='bare',created_at=2023-11-15T14:18:49Z,direct_url=<?>,disk_format='qcow2',id=363aace8-2c2f-4e78-a444-1dfec4b36add,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1702806374-shelved',owner='05fc70face4045788f0a46bd4cc29867',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T14:18:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRqscaif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'ffa60aac-02a4-42ab-b97b-b9cc56079e44', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3f5accf-d711-46f6-bf5e-631621cb2b0f', 'serial': 'd3f5accf-d711-46f6-bf5e-631621cb2b0f'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '11945a34-7fca-48e7-b251-b82be687a92d', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:20:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:20:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='717796622a65e3a485da046d3d94bc41',container_format='bare',created_at=2023-11-15T14:18:49Z,direct_url=<?>,disk_format='qcow2',id=363aace8-2c2f-4e78-a444-1dfec4b36add,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1702806374-shelved',owner='05fc70face4045788f0a46bd4cc29867',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T14:18:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'vcpu_model' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.objects.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<ffa60aac-02a4-42ab-b97b-b9cc56079e44> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRqscaif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:20:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:20:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:20:55 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb21c63-3725-4559-8608-27ad7f806043]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:20:55 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[389152c3-0e9b-4510-aba9-a5298f1956f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f] added
Nov 15 14:20:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance destroyed successfully.
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1703018691-network", "vif_mac": "fa:16:3e:3d:a8:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1703018691-network", "vif_mac": "fa:16:3e:3d:a8:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_vif [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4426f0fd-a2, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[268976b1-4f5f-4401-915a-044ace65f218]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cafd0cd7-9ab9-4435-9a96-d171333b8681) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:55 user nova-compute[74892]: INFO os_vif [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2')
Nov 15 14:20:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:20:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf9cfab-4535-49b1-afbc-6ccb0f553130]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRqscaif {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRqscaif" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[31016b03-a619-4895-b011-65ff53348d0e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRqscaif'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4449102-5a37-487d-a409-aa09e4609a40]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[564b905b-c7fe-498f-b95e-f6e645525c5a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:20:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:20:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f48e9-1c59-4dc2-93d1-1639f7a064bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f, portal: 172.16.0.220,3260]
Nov 15 14:20:55 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f, portal: 172.16.0.220,3260] successful.
Nov 15 14:20:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4c560-4bb2-43dd-a84f-39f4aa4ec638]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d764687e-7f20-4fe2-80d0-65abd6e96f7e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:20:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:20:55 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:20:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a867f2a5-69d7-4685-a452-d3940c2f8262]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:20:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRqscaif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26336643134366639', 'path': '/dev/sde'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336643134366639', 'path': '/dev/sde'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.253s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d8c616-2f42-4653-8fb2-dd5721c7ff7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:20:56 user nova-compute[74892]: No targets found.
Nov 15 14:20:56 user nova-compute[74892]: iSNS:
Nov 15 14:20:56 user nova-compute[74892]: No targets found.
Nov 15 14:20:56 user nova-compute[74892]: STATIC:
Nov 15 14:20:56 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f
Nov 15 14:20:56 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:56 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:56 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8
Nov 15 14:20:56 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:56 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:56 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:20:56 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:56 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:56 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:20:56 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:56 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:56 user nova-compute[74892]: FIRMWARE:
Nov 15 14:20:56 user nova-compute[74892]: No targets found.
Nov 15 14:20:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:20:56 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:20:56 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1702806374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1702806374',id=4,image_ref='363aace8-2c2f-4e78-a444-1dfec4b36add',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1680936907',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ryzg4t4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member',shelved_at='2023-11-15T14:18:53.619854',shelved_host='user',shelved_image_id='363aace8-2c2f-4e78-a444-1dfec4b36add'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=ffa60aac-02a4-42ab-b97b-b9cc56079e44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'pci_devices' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.objects.base [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<ffa60aac-02a4-42ab-b97b-b9cc56079e44> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:20:56 user nova-compute[74892]:   <uuid>ffa60aac-02a4-42ab-b97b-b9cc56079e44</uuid>
Nov 15 14:20:56 user nova-compute[74892]:   <name>instance-00000004</name>
Nov 15 14:20:56 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:20:56 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:20:56 user nova-compute[74892]:   <metadata>
Nov 15 14:20:56 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:20:56 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:20:56 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1702806374</nova:name>
Nov 15 14:20:56 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:20:55</nova:creationTime>
Nov 15 14:20:56 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:20:56 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:20:56 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:20:56 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:20:56 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:20:56 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:20:56 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:20:56 user nova-compute[74892]:       <nova:owner>
Nov 15 14:20:56 user nova-compute[74892]:         <nova:user uuid="0c3e99992fb747808166fdd03a2420ff">tempest-AttachVolumeShelveTestJSON-769417742-project-member</nova:user>
Nov 15 14:20:56 user nova-compute[74892]:         <nova:project uuid="05fc70face4045788f0a46bd4cc29867">tempest-AttachVolumeShelveTestJSON-769417742</nova:project>
Nov 15 14:20:56 user nova-compute[74892]:       </nova:owner>
Nov 15 14:20:56 user nova-compute[74892]:       <nova:root type="image" uuid="363aace8-2c2f-4e78-a444-1dfec4b36add"/>
Nov 15 14:20:56 user nova-compute[74892]:       <nova:ports>
Nov 15 14:20:56 user nova-compute[74892]:         <nova:port uuid="571e109b-b616-4b07-84af-97aac4371356">
Nov 15 14:20:56 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 14:20:56 user nova-compute[74892]:         </nova:port>
Nov 15 14:20:56 user nova-compute[74892]:       </nova:ports>
Nov 15 14:20:56 user nova-compute[74892]:     </nova:instance>
Nov 15 14:20:56 user nova-compute[74892]:   </metadata>
Nov 15 14:20:56 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:20:56 user nova-compute[74892]:     <system>
Nov 15 14:20:56 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:20:56 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:20:56 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:20:56 user nova-compute[74892]:       <entry name="serial">ffa60aac-02a4-42ab-b97b-b9cc56079e44</entry>
Nov 15 14:20:56 user nova-compute[74892]:       <entry name="uuid">ffa60aac-02a4-42ab-b97b-b9cc56079e44</entry>
Nov 15 14:20:56 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:20:56 user nova-compute[74892]:     </system>
Nov 15 14:20:56 user nova-compute[74892]:   </sysinfo>
Nov 15 14:20:56 user nova-compute[74892]:   <os>
Nov 15 14:20:56 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:20:56 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:20:56 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:20:56 user nova-compute[74892]:   </os>
Nov 15 14:20:56 user nova-compute[74892]:   <features>
Nov 15 14:20:56 user nova-compute[74892]:     <acpi/>
Nov 15 14:20:56 user nova-compute[74892]:     <apic/>
Nov 15 14:20:56 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:20:56 user nova-compute[74892]:   </features>
Nov 15 14:20:56 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:20:56 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:20:56 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:20:56 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:20:56 user nova-compute[74892]:   </clock>
Nov 15 14:20:56 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:20:56 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:20:56 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:20:56 user nova-compute[74892]:   </cpu>
Nov 15 14:20:56 user nova-compute[74892]:   <devices>
Nov 15 14:20:56 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:20:56 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:20:56 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk"/>
Nov 15 14:20:56 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:20:56 user nova-compute[74892]:     </disk>
Nov 15 14:20:56 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:20:56 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:20:56 user nova-compute[74892]:       <source dev="/dev/sde"/>
Nov 15 14:20:56 user nova-compute[74892]:       <target dev="vdc" bus="virtio"/>
Nov 15 14:20:56 user nova-compute[74892]:       <serial>d3f5accf-d711-46f6-bf5e-631621cb2b0f</serial>
Nov 15 14:20:56 user nova-compute[74892]:     </disk>
Nov 15 14:20:56 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:20:56 user nova-compute[74892]:       <mac address="fa:16:3e:2e:95:f5"/>
Nov 15 14:20:56 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:20:56 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:20:56 user nova-compute[74892]:       <target dev="tap571e109b-b6"/>
Nov 15 14:20:56 user nova-compute[74892]:     </interface>
Nov 15 14:20:56 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:20:56 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/console.log" append="off"/>
Nov 15 14:20:56 user nova-compute[74892]:     </serial>
Nov 15 14:20:56 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:20:56 user nova-compute[74892]:     <video>
Nov 15 14:20:56 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:20:56 user nova-compute[74892]:     </video>
Nov 15 14:20:56 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:20:56 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:20:56 user nova-compute[74892]:     </rng>
Nov 15 14:20:56 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:20:56 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:20:56 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:20:56 user nova-compute[74892]:     </memballoon>
Nov 15 14:20:56 user nova-compute[74892]:   </devices>
Nov 15 14:20:56 user nova-compute[74892]: </domain>
Nov 15 14:20:56 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1702806374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1702806374',id=4,image_ref='363aace8-2c2f-4e78-a444-1dfec4b36add',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1680936907',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ryzg4t4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member',shelved_at='2023-11-15T14:18:53.619854',shelved_host='user',shelved_image_id='363aace8-2c2f-4e78-a444-1dfec4b36add'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=ffa60aac-02a4-42ab-b97b-b9cc56079e44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_vif [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f83a18-6c6f-4ec4-9401-08bf2810614f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4b05c12-cc08-55a6-90a4-fcca7cb05910', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap571e109b-b6, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap571e109b-b6, col_values=(('qos', UUID('4b4be3cd-81b8-48d1-a105-f3dbc3a2481c')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap571e109b-b6, col_values=(('external_ids', {'iface-id': '571e109b-b616-4b07-84af-97aac4371356', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:95:f5', 'vm-uuid': 'ffa60aac-02a4-42ab-b97b-b9cc56079e44'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:56 user nova-compute[74892]: INFO os_vif [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6')
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c3f619-5b0c-4d2c-b539-d9e4eadbe850]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:56 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:56 user nova-compute[74892]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:20:56 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:20:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:56 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:56 user nova-compute[74892]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:20:56 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:20:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd0063bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0064ace3-bd27-4073-a885-59b2a61edd78]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f38454-c447-4342-a183-3ae4258da20b]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No VIF found with MAC fa:16:3e:2e:95:f5, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[22841ac2-f5dd-42e3-b935-166e88543472]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e1dbf7-36f7-40cc-94ad-05e5c943ed25]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8765aad8-fb2a-4e11-b6ae-32408c4689ae]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-47a90a1f-2f5d-426d-b0a5-311bf1ace98d req-db3d3a51-d1fa-42b3-bdef-18fdc8757554 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47a90a1f-2f5d-426d-b0a5-311bf1ace98d req-db3d3a51-d1fa-42b3-bdef-18fdc8757554 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47a90a1f-2f5d-426d-b0a5-311bf1ace98d req-db3d3a51-d1fa-42b3-bdef-18fdc8757554 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47a90a1f-2f5d-426d-b0a5-311bf1ace98d req-db3d3a51-d1fa-42b3-bdef-18fdc8757554 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-47a90a1f-2f5d-426d-b0a5-311bf1ace98d req-db3d3a51-d1fa-42b3-bdef-18fdc8757554 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:56 user nova-compute[74892]: WARNING nova.compute.manager [req-47a90a1f-2f5d-426d-b0a5-311bf1ace98d req-db3d3a51-d1fa-42b3-bdef-18fdc8757554 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state active and task_state resize_migrating.
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a9e80e-2127-49e9-988a-9ed4494ef94a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]
Nov 15 14:20:56 user nova-compute[74892]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:20:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab6db73-56df-47d5-b414-cc9855e8da90]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== disconnect_volume: return (1588ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:20:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963_resize/disk /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:57 user nova-compute[74892]: INFO nova.compute.manager [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Terminating instance
Nov 15 14:20:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "cp -r /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963_resize/disk /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk" returned: 0 in 0.611s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963_resize/disk.info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk.info {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "cp -r /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963_resize/disk.info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk.info" returned: 0 in 0.073s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-a49baa24-59b0-4c5a-b69e-b95bb964bd81 req-ccf455fd-7d97-4a4b-966c-aa1f0a7db6ce service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a49baa24-59b0-4c5a-b69e-b95bb964bd81 req-ccf455fd-7d97-4a4b-966c-aa1f0a7db6ce service nova] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a49baa24-59b0-4c5a-b69e-b95bb964bd81 req-ccf455fd-7d97-4a4b-966c-aa1f0a7db6ce service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a49baa24-59b0-4c5a-b69e-b95bb964bd81 req-ccf455fd-7d97-4a4b-966c-aa1f0a7db6ce service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-a49baa24-59b0-4c5a-b69e-b95bb964bd81 req-ccf455fd-7d97-4a4b-966c-aa1f0a7db6ce service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] No waiting events found dispatching network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:58 user nova-compute[74892]: WARNING nova.compute.manager [req-a49baa24-59b0-4c5a-b69e-b95bb964bd81 req-ccf455fd-7d97-4a4b-966c-aa1f0a7db6ce service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received unexpected event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 14:20:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-unplugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] No waiting events found dispatching network-vif-unplugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-unplugged-1130e682-747f-499b-9d41-0ed33fd5e873 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] Acquiring lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] No waiting events found dispatching network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:20:58 user nova-compute[74892]: WARNING nova.compute.manager [req-e1926d7d-fb15-41cd-baa6-2579e7cd7d60 req-86e2694c-bb92-4f1c-82a1-8ace3e64d940 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received unexpected event network-vif-plugged-1130e682-747f-499b-9d41-0ed33fd5e873 for instance with vm_state active and task_state deleting.
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:59 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Instance destroyed successfully.
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.objects.instance [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lazy-loading 'resources' on Instance uuid c155e78a-3bb5-46b1-ac34-0bace9450318 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1107235037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-336786677',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2KiKDdXeNAqvnhWOe4IokiJsPszuyRac/hr6RiPGlUzitCsmqUIxYtGGZBpsS3bdXKowuUuVkKL67IqO63L//BO28Js1mUKMzps/11gW1kNdrY79SZ72XLSRRQSAhs3A==',key_name='tempest-keypair-1595477803',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:19:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92bc8d0616234fdf92d29834bda6d906',ramdisk_id='',reservation_id='r-3s6xwekg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-458086644',owner_user_name='tempest-ServerActionsV293TestJSON-458086644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='92f2936bf65e4ca3be5b6f81718d8a91',uuid=c155e78a-3bb5-46b1-ac34-0bace9450318,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converting VIF {"id": "1130e682-747f-499b-9d41-0ed33fd5e873", "address": "fa:16:3e:4c:c7:00", "network": {"id": "2d0e8d5e-ad45-447e-baf6-65df15a8d8fd", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-45898764-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92bc8d0616234fdf92d29834bda6d906", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1130e682-74", "ovs_interfaceid": "1130e682-747f-499b-9d41-0ed33fd5e873", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_vif [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1130e682-74, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b4ed89b-74c9-4024-bee3-b4f5cb50e592) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:20:59 user nova-compute[74892]: INFO os_vif [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=1130e682-747f-499b-9d41-0ed33fd5e873,network=Network(2d0e8d5e-ad45-447e-baf6-65df15a8d8fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1130e682-74')
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'purWlUhz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:20:59 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb47de5-e63b-4337-87f4-0a6334377b0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:20:59 user nova-compute[74892]: No targets found.
Nov 15 14:20:59 user nova-compute[74892]: iSNS:
Nov 15 14:20:59 user nova-compute[74892]: No targets found.
Nov 15 14:20:59 user nova-compute[74892]: STATIC:
Nov 15 14:20:59 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f
Nov 15 14:20:59 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:59 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:59 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a
Nov 15 14:20:59 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:59 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:59 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:20:59 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:20:59 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:20:59 user nova-compute[74892]: FIRMWARE:
Nov 15 14:20:59 user nova-compute[74892]: No targets found.
Nov 15 14:20:59 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:20:59 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:20:59 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d2ed91-1320-463c-92e4-1abcd31e1e39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2365c26-95b9-42c6-bd2b-c42cc405d09e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:59 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:59 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:20:59 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a (non-flash)
Nov 15 14:20:59 user nova-compute[74892]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:20:59 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:20:59 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd007caf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[420b10e4-02c2-4a1b-b8a2-4814f75c0077]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6b5306-6ef3-471f-bfc7-23966da15bdc]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d134c2-b525-4f06-bd74-b4f92c1900c8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Port 4426f0fd-a229-4b73-a68e-6b9456304d1c binding to destination host user is already ACTIVE {{(pid=74892) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2db1203-1484-46bb-be65-c97a04a47923]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[066412c1-7922-4e68-bdaf-95c6a8365690]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[478c4455-cb9a-4977-8ecf-380316816b92]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260]
Nov 15 14:20:59 user nova-compute[74892]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a, portal: 172.16.0.220,3260] successful.
Nov 15 14:20:59 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f2ba5dc0-2823-48ed-98ff-bc471a20f00a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd7b4aa-548a-452b-9706-cc8034a820a9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] <== disconnect_volume: return (330ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:20:59 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Deleting instance files /opt/stack/data/nova/instances/c155e78a-3bb5-46b1-ac34-0bace9450318_del
Nov 15 14:20:59 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Deletion of /opt/stack/data/nova/instances/c155e78a-3bb5-46b1-ac34-0bace9450318_del complete
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:20:59 user nova-compute[74892]: INFO nova.compute.manager [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:20:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:00 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Took 0.79 seconds to deallocate network for instance.
Nov 15 14:21:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a7bef5e-8c08-481e-b185-7d5707522b9f req-4903ee18-c0ce-4058-8890-a436ab4a9524 service nova] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Received event network-vif-deleted-1130e682-747f-499b-9d41-0ed33fd5e873 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG os_brick.utils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[384ddcb5-cccf-4fa5-a60d-7aa04f97ea7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aab839-a538-4050-81a9-161ad135a760]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0c3717-716b-468b-8ae3-83a0c4086fe4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3466b4-2503-49a5-9209-b108b23322f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-8db0d4ff-9f65-46de-b2d8-59225a065480 req-4e9f2fab-0c73-4822-937f-439d926a2630 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8db0d4ff-9f65-46de-b2d8-59225a065480 req-4e9f2fab-0c73-4822-937f-439d926a2630 service nova] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8db0d4ff-9f65-46de-b2d8-59225a065480 req-4e9f2fab-0c73-4822-937f-439d926a2630 service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8db0d4ff-9f65-46de-b2d8-59225a065480 req-4e9f2fab-0c73-4822-937f-439d926a2630 service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG nova.compute.manager [req-8db0d4ff-9f65-46de-b2d8-59225a065480 req-4e9f2fab-0c73-4822-937f-439d926a2630 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] No waiting events found dispatching network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:00 user nova-compute[74892]: WARNING nova.compute.manager [req-8db0d4ff-9f65-46de-b2d8-59225a065480 req-4e9f2fab-0c73-4822-937f-439d926a2630 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received unexpected event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:21:00 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:21:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccea98d-f00c-4e4f-ba78-536a25da60cb]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG os_brick.utils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:21:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:21:00 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance spawned successfully.
Nov 15 14:21:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:21:01 user nova-compute[74892]: INFO nova.compute.manager [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Took 0.92 seconds to detach 1 volumes for instance.
Nov 15 14:21:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] [instance: c155e78a-3bb5-46b1-ac34-0bace9450318] Deleting volume: f2ba5dc0-2823-48ed-98ff-bc471a20f00a {{(pid=74892) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 14:21:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4c10f23b-cc5e-485e-a519-a797f3d8b4dc tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.075s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:01 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:01 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.480s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:01 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Deleted allocations for instance c155e78a-3bb5-46b1-ac34-0bace9450318
Nov 15 14:21:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8519057e-10ab-4f25-8f3f-5e0d0a981eb2 tempest-ServerActionsV293TestJSON-458086644 tempest-ServerActionsV293TestJSON-458086644-project-member] Lock "c155e78a-3bb5-46b1-ac34-0bace9450318" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.239s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:21:05 user nova-compute[74892]: INFO nova.compute.claims [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Claim successful on node user
Nov 15 14:21:05 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:21:05 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:21:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:21:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.policy [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a85e0d65c2248e0aca031055b162e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5649287d611341a7850ed74e51b7bfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:21:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Creating image(s)
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Starting finish_migration {{(pid=74892) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance directory exists: not creating {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 14:21:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Creating image(s)
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.203s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.200s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk. size=21474836480 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.213s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk 1073741824" returned: 0 in 0.068s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk 21474836480 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Successfully created port: 904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk 21474836480" returned: 0 in 0.050s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Ensure instance console log exists: /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Start _get_guest_xml network_info=[{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1703018691-network", "vif_mac": "fa:16:3e:3d:a8:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2cd7a807-53cb-44d6-91cd-3a58b36f2963', 'attached_at': '2023-11-15T14:21:06.000000', 'detached_at': '', 'volume_id': 'dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'serial': 'dc2faf3f-3393-465a-89b4-f7601e07c2e8'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '54dd554b-8ac2-40d0-861e-322d162d46b6', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:21:06 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:06 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:21:06 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:21:06 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:21:06 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.215s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bcde90-6eb6-4b76-9cf2-be9322e04383]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:21:06 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bb8420-62ee-4f35-b5cf-f9a9d74a391c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8] added
Nov 15 14:21:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62bd612-ce0c-4ffd-ad8d-93fa0d0da0c4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4d0183-7131-48e8-9547-b6de851035a6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yihUezAH {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yihUezAH" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd44cfd-ee1d-4423-a799-0a719da7899b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yihUezAH'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6da5a1f-a633-408c-bbb8-70e46dc6ae75]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Cannot resize image /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Ensure instance console log exists: /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dcf443-4f9c-4266-8822-c4a79d1ab39d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:21:07 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:21:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:21:07 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:21:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e59fa7-29cb-445e-bc6c-0b8857633d5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]
Nov 15 14:21:07 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:21:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0de21d-34a3-48e0-9d00-7bce31195cd0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b0097-8d62-474c-bdcc-7a5024377663]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:21:07 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:21:07 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:21:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:21:07 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:21:07 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:21:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08a898-6e88-4a86-a65e-1917d84879f2]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Successfully updated port: 904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquired lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-2e3c5f41-1e04-41c0-8a51-e27ecfdfe7e9 req-2195c42f-997c-4ceb-a5c4-75d3aa07aa17 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-changed-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-2e3c5f41-1e04-41c0-8a51-e27ecfdfe7e9 req-2195c42f-997c-4ceb-a5c4-75d3aa07aa17 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Refreshing instance network info cache due to event network-changed-904d19af-084f-43ac-8378-cf5b7e822961. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2e3c5f41-1e04-41c0-8a51-e27ecfdfe7e9 req-2195c42f-997c-4ceb-a5c4-75d3aa07aa17 service nova] Acquiring lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating instance_info_cache with network_info: [{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Releasing lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance network_info: |[{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2e3c5f41-1e04-41c0-8a51-e27ecfdfe7e9 req-2195c42f-997c-4ceb-a5c4-75d3aa07aa17 service nova] Acquired lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.network.neutron [req-2e3c5f41-1e04-41c0-8a51-e27ecfdfe7e9 req-2195c42f-997c-4ceb-a5c4-75d3aa07aa17 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Refreshing network info cache for port 904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:21:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Start _get_guest_xml network_info=[{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:21:07 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:07 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.objects.instance [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'pci_devices' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:21:08 user nova-compute[74892]:   <uuid>45201330-05c4-4109-99c2-d17761f46add</uuid>
Nov 15 14:21:08 user nova-compute[74892]:   <name>instance-00000011</name>
Nov 15 14:21:08 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:21:08 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:21:08 user nova-compute[74892]:   <metadata>
Nov 15 14:21:08 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:21:08 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeTestJSON-server-423975802</nova:name>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:21:07</nova:creationTime>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:21:08 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:21:08 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:owner>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:user uuid="1a85e0d65c2248e0aca031055b162e86">tempest-AttachVolumeTestJSON-1499270628-project-member</nova:user>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:project uuid="5649287d611341a7850ed74e51b7bfe3">tempest-AttachVolumeTestJSON-1499270628</nova:project>
Nov 15 14:21:08 user nova-compute[74892]:       </nova:owner>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:ports>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:port uuid="904d19af-084f-43ac-8378-cf5b7e822961">
Nov 15 14:21:08 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:21:08 user nova-compute[74892]:         </nova:port>
Nov 15 14:21:08 user nova-compute[74892]:       </nova:ports>
Nov 15 14:21:08 user nova-compute[74892]:     </nova:instance>
Nov 15 14:21:08 user nova-compute[74892]:   </metadata>
Nov 15 14:21:08 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:21:08 user nova-compute[74892]:     <system>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="serial">45201330-05c4-4109-99c2-d17761f46add</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="uuid">45201330-05c4-4109-99c2-d17761f46add</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:21:08 user nova-compute[74892]:     </system>
Nov 15 14:21:08 user nova-compute[74892]:   </sysinfo>
Nov 15 14:21:08 user nova-compute[74892]:   <os>
Nov 15 14:21:08 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:21:08 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:21:08 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:21:08 user nova-compute[74892]:   </os>
Nov 15 14:21:08 user nova-compute[74892]:   <features>
Nov 15 14:21:08 user nova-compute[74892]:     <acpi/>
Nov 15 14:21:08 user nova-compute[74892]:     <apic/>
Nov 15 14:21:08 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:21:08 user nova-compute[74892]:   </features>
Nov 15 14:21:08 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:21:08 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:21:08 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:21:08 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:21:08 user nova-compute[74892]:   </clock>
Nov 15 14:21:08 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:21:08 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:21:08 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:21:08 user nova-compute[74892]:   </cpu>
Nov 15 14:21:08 user nova-compute[74892]:   <devices>
Nov 15 14:21:08 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:21:08 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:21:08 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk"/>
Nov 15 14:21:08 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:21:08 user nova-compute[74892]:     </disk>
Nov 15 14:21:08 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:21:08 user nova-compute[74892]:       <mac address="fa:16:3e:2f:62:55"/>
Nov 15 14:21:08 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:08 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:21:08 user nova-compute[74892]:       <target dev="tap904d19af-08"/>
Nov 15 14:21:08 user nova-compute[74892]:     </interface>
Nov 15 14:21:08 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:21:08 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/console.log" append="off"/>
Nov 15 14:21:08 user nova-compute[74892]:     </serial>
Nov 15 14:21:08 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:21:08 user nova-compute[74892]:     <video>
Nov 15 14:21:08 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:08 user nova-compute[74892]:     </video>
Nov 15 14:21:08 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:21:08 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:21:08 user nova-compute[74892]:     </rng>
Nov 15 14:21:08 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:21:08 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:21:08 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:21:08 user nova-compute[74892]:     </memballoon>
Nov 15 14:21:08 user nova-compute[74892]:   </devices>
Nov 15 14:21:08 user nova-compute[74892]: </domain>
Nov 15 14:21:08 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG os_vif [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15419c0f-5df6-57b2-9991-dab7b4d2f56c', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap904d19af-08, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap904d19af-08, col_values=(('qos', UUID('a9ae739c-e577-4318-a12f-1c46cd1e735a')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap904d19af-08, col_values=(('external_ids', {'iface-id': '904d19af-084f-43ac-8378-cf5b7e822961', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:62:55', 'vm-uuid': '45201330-05c4-4109-99c2-d17761f46add'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: INFO os_vif [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08')
Nov 15 14:21:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26461373031623838', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461373031623838', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No VIF found with MAC fa:16:3e:2f:62:55, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1703018691-network", "vif_mac": "fa:16:3e:3d:a8:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1703018691-network", "vif_mac": "fa:16:3e:3d:a8:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:21:08 user nova-compute[74892]:   <uuid>2cd7a807-53cb-44d6-91cd-3a58b36f2963</uuid>
Nov 15 14:21:08 user nova-compute[74892]:   <name>instance-00000002</name>
Nov 15 14:21:08 user nova-compute[74892]:   <memory>2097152</memory>
Nov 15 14:21:08 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:21:08 user nova-compute[74892]:   <metadata>
Nov 15 14:21:08 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:21:08 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:name>tempest-ServerActionsTestOtherB-server-151320545</nova:name>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:21:06</nova:creationTime>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:flavor name="m1.small">
Nov 15 14:21:08 user nova-compute[74892]:         <nova:memory>2048</nova:memory>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:disk>20</nova:disk>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:21:08 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:owner>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:user uuid="971828fdd5de481faf9ff0403ecdd3b0">tempest-ServerActionsTestOtherB-1188247760-project-member</nova:user>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:project uuid="7fe4fd8971a248c0a7058a1ff448ac92">tempest-ServerActionsTestOtherB-1188247760</nova:project>
Nov 15 14:21:08 user nova-compute[74892]:       </nova:owner>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:21:08 user nova-compute[74892]:       <nova:ports>
Nov 15 14:21:08 user nova-compute[74892]:         <nova:port uuid="4426f0fd-a229-4b73-a68e-6b9456304d1c">
Nov 15 14:21:08 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:21:08 user nova-compute[74892]:         </nova:port>
Nov 15 14:21:08 user nova-compute[74892]:       </nova:ports>
Nov 15 14:21:08 user nova-compute[74892]:     </nova:instance>
Nov 15 14:21:08 user nova-compute[74892]:   </metadata>
Nov 15 14:21:08 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:21:08 user nova-compute[74892]:     <system>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="serial">2cd7a807-53cb-44d6-91cd-3a58b36f2963</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="uuid">2cd7a807-53cb-44d6-91cd-3a58b36f2963</entry>
Nov 15 14:21:08 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:21:08 user nova-compute[74892]:     </system>
Nov 15 14:21:08 user nova-compute[74892]:   </sysinfo>
Nov 15 14:21:08 user nova-compute[74892]:   <os>
Nov 15 14:21:08 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:21:08 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:21:08 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:21:08 user nova-compute[74892]:   </os>
Nov 15 14:21:08 user nova-compute[74892]:   <features>
Nov 15 14:21:08 user nova-compute[74892]:     <acpi/>
Nov 15 14:21:08 user nova-compute[74892]:     <apic/>
Nov 15 14:21:08 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:21:08 user nova-compute[74892]:   </features>
Nov 15 14:21:08 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:21:08 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:21:08 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:21:08 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:21:08 user nova-compute[74892]:   </clock>
Nov 15 14:21:08 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:21:08 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:21:08 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:21:08 user nova-compute[74892]:   </cpu>
Nov 15 14:21:08 user nova-compute[74892]:   <devices>
Nov 15 14:21:08 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:21:08 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:21:08 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk"/>
Nov 15 14:21:08 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:21:08 user nova-compute[74892]:     </disk>
Nov 15 14:21:08 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:21:08 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:21:08 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:21:08 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:21:08 user nova-compute[74892]:       <serial>dc2faf3f-3393-465a-89b4-f7601e07c2e8</serial>
Nov 15 14:21:08 user nova-compute[74892]:     </disk>
Nov 15 14:21:08 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:21:08 user nova-compute[74892]:       <mac address="fa:16:3e:3d:a8:cd"/>
Nov 15 14:21:08 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:08 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:21:08 user nova-compute[74892]:       <target dev="tap4426f0fd-a2"/>
Nov 15 14:21:08 user nova-compute[74892]:     </interface>
Nov 15 14:21:08 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:21:08 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/console.log" append="off"/>
Nov 15 14:21:08 user nova-compute[74892]:     </serial>
Nov 15 14:21:08 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:21:08 user nova-compute[74892]:     <video>
Nov 15 14:21:08 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:08 user nova-compute[74892]:     </video>
Nov 15 14:21:08 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:21:08 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:21:08 user nova-compute[74892]:     </rng>
Nov 15 14:21:08 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:21:08 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:21:08 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:21:08 user nova-compute[74892]:     </memballoon>
Nov 15 14:21:08 user nova-compute[74892]:   </devices>
Nov 15 14:21:08 user nova-compute[74892]: </domain>
Nov 15 14:21:08 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:20:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1703018691-network", "vif_mac": "fa:16:3e:3d:a8:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1703018691-network", "vif_mac": "fa:16:3e:3d:a8:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG os_vif [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c41c25ff-c945-50b8-8734-dd44f47af686', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4426f0fd-a2, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4426f0fd-a2, col_values=(('qos', UUID('fb2dba89-d1e1-4459-9d48-6b53df589092')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4426f0fd-a2, col_values=(('external_ids', {'iface-id': '4426f0fd-a229-4b73-a68e-6b9456304d1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:a8:cd', 'vm-uuid': '2cd7a807-53cb-44d6-91cd-3a58b36f2963'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:08 user nova-compute[74892]: INFO os_vif [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2')
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] No VIF found with MAC fa:16:3e:3d:a8:cd, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-2e3c5f41-1e04-41c0-8a51-e27ecfdfe7e9 req-2195c42f-997c-4ceb-a5c4-75d3aa07aa17 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updated VIF entry in instance network info cache for port 904d19af-084f-43ac-8378-cf5b7e822961. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-2e3c5f41-1e04-41c0-8a51-e27ecfdfe7e9 req-2195c42f-997c-4ceb-a5c4-75d3aa07aa17 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating instance_info_cache with network_info: [{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2e3c5f41-1e04-41c0-8a51-e27ecfdfe7e9 req-2195c42f-997c-4ceb-a5c4-75d3aa07aa17 service nova] Releasing lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-6e441780-02fc-4559-b6a1-eaf23fcab0b5 req-4a67219b-61bd-4a30-852b-77ecc3ece70b service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6e441780-02fc-4559-b6a1-eaf23fcab0b5 req-4a67219b-61bd-4a30-852b-77ecc3ece70b service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6e441780-02fc-4559-b6a1-eaf23fcab0b5 req-4a67219b-61bd-4a30-852b-77ecc3ece70b service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6e441780-02fc-4559-b6a1-eaf23fcab0b5 req-4a67219b-61bd-4a30-852b-77ecc3ece70b service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-6e441780-02fc-4559-b6a1-eaf23fcab0b5 req-4a67219b-61bd-4a30-852b-77ecc3ece70b service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:11 user nova-compute[74892]: WARNING nova.compute.manager [req-6e441780-02fc-4559-b6a1-eaf23fcab0b5 req-4a67219b-61bd-4a30-852b-77ecc3ece70b service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state building and task_state spawning.
Nov 15 14:21:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-1ec1803a-e87a-44e8-8b68-8f41dbc1f583 req-23caf61a-79d1-443c-a4e2-1b3270c1f010 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1ec1803a-e87a-44e8-8b68-8f41dbc1f583 req-23caf61a-79d1-443c-a4e2-1b3270c1f010 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1ec1803a-e87a-44e8-8b68-8f41dbc1f583 req-23caf61a-79d1-443c-a4e2-1b3270c1f010 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1ec1803a-e87a-44e8-8b68-8f41dbc1f583 req-23caf61a-79d1-443c-a4e2-1b3270c1f010 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-1ec1803a-e87a-44e8-8b68-8f41dbc1f583 req-23caf61a-79d1-443c-a4e2-1b3270c1f010 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:11 user nova-compute[74892]: WARNING nova.compute.manager [req-1ec1803a-e87a-44e8-8b68-8f41dbc1f583 req-23caf61a-79d1-443c-a4e2-1b3270c1f010 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state active and task_state resize_finish.
Nov 15 14:21:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-f145a869-4976-4f51-9a95-5cebca26ae34 req-a51e6ed9-7c10-4e58-9d1c-57e32d32f9ee service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f145a869-4976-4f51-9a95-5cebca26ae34 req-a51e6ed9-7c10-4e58-9d1c-57e32d32f9ee service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f145a869-4976-4f51-9a95-5cebca26ae34 req-a51e6ed9-7c10-4e58-9d1c-57e32d32f9ee service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f145a869-4976-4f51-9a95-5cebca26ae34 req-a51e6ed9-7c10-4e58-9d1c-57e32d32f9ee service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-f145a869-4976-4f51-9a95-5cebca26ae34 req-a51e6ed9-7c10-4e58-9d1c-57e32d32f9ee service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:13 user nova-compute[74892]: WARNING nova.compute.manager [req-f145a869-4976-4f51-9a95-5cebca26ae34 req-a51e6ed9-7c10-4e58-9d1c-57e32d32f9ee service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state building and task_state spawning.
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a5bc4c7-fdb6-4b6c-9245-10f6e72681a6 req-91e21e07-a771-47d6-9ce8-42c732f35cd3 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a5bc4c7-fdb6-4b6c-9245-10f6e72681a6 req-91e21e07-a771-47d6-9ce8-42c732f35cd3 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a5bc4c7-fdb6-4b6c-9245-10f6e72681a6 req-91e21e07-a771-47d6-9ce8-42c732f35cd3 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7a5bc4c7-fdb6-4b6c-9245-10f6e72681a6 req-91e21e07-a771-47d6-9ce8-42c732f35cd3 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-7a5bc4c7-fdb6-4b6c-9245-10f6e72681a6 req-91e21e07-a771-47d6-9ce8-42c732f35cd3 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:13 user nova-compute[74892]: WARNING nova.compute.manager [req-7a5bc4c7-fdb6-4b6c-9245-10f6e72681a6 req-91e21e07-a771-47d6-9ce8-42c732f35cd3 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state active and task_state resize_finish.
Nov 15 14:21:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:21:13 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance spawned successfully.
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:13 user nova-compute[74892]: INFO nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Took 7.69 seconds to spawn the instance on the hypervisor.
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:21:13 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance running successfully.
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Failed to set time: agent not configured {{(pid=74892) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 14:21:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-63fda0ae-646b-4291-be02-7fa4532b0268 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] finish_migration finished successfully. {{(pid=74892) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 14:21:13 user nova-compute[74892]: INFO nova.compute.manager [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Took 8.75 seconds to build instance.
Nov 15 14:21:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0c322db-a2cf-4bbf-8105-0deaff0b9ff3 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.874s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:21:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:16 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:21:16 user nova-compute[74892]: INFO nova.compute.claims [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Claim successful on node user
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:21:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.policy [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca983885487f44c589101440835f1f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b56830838db45b1aa0621736a5ed53a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:21:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Creating image(s)
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "/opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "/opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "/opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.215s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk 1073741824" returned: 0 in 0.062s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:17 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Successfully created port: 2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.229s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Cannot resize image /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Ensure instance console log exists: /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Successfully updated port: 2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "refresh_cache-a75e0d21-e9e0-4da9-a328-bac6aea1755c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquired lock "refresh_cache-a75e0d21-e9e0-4da9-a328-bac6aea1755c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-dadf4fa5-f08f-47ec-b9d1-a27770d9336e req-36dcfb10-9d94-4ce4-b6f2-35df47787c74 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received event network-changed-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-dadf4fa5-f08f-47ec-b9d1-a27770d9336e req-36dcfb10-9d94-4ce4-b6f2-35df47787c74 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Refreshing instance network info cache due to event network-changed-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dadf4fa5-f08f-47ec-b9d1-a27770d9336e req-36dcfb10-9d94-4ce4-b6f2-35df47787c74 service nova] Acquiring lock "refresh_cache-a75e0d21-e9e0-4da9-a328-bac6aea1755c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:21:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Updating instance_info_cache with network_info: [{"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Releasing lock "refresh_cache-a75e0d21-e9e0-4da9-a328-bac6aea1755c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Instance network_info: |[{"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dadf4fa5-f08f-47ec-b9d1-a27770d9336e req-36dcfb10-9d94-4ce4-b6f2-35df47787c74 service nova] Acquired lock "refresh_cache-a75e0d21-e9e0-4da9-a328-bac6aea1755c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.network.neutron [req-dadf4fa5-f08f-47ec-b9d1-a27770d9336e req-36dcfb10-9d94-4ce4-b6f2-35df47787c74 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Refreshing network info cache for port 2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Start _get_guest_xml network_info=[{"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:21:20 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:20 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1587713122',display_name='tempest-VolumesNegativeTest-instance-1587713122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1587713122',id=18,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b56830838db45b1aa0621736a5ed53a',ramdisk_id='',reservation_id='r-jk4a3uq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-754367886',owner_user_name='tempest-VolumesNegativeTest-754367886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:17Z,user_data=None,user_id='ca983885487f44c589101440835f1f98',uuid=a75e0d21-e9e0-4da9-a328-bac6aea1755c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Converting VIF {"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e9:3e,bridge_name='br-int',has_traffic_filtering=True,id=2b615c02-ce10-4a9f-8e2b-7a6bbc49170a,network=Network(ac396435-1680-422d-9905-e9162b29c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b615c02-ce') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lazy-loading 'pci_devices' on Instance uuid a75e0d21-e9e0-4da9-a328-bac6aea1755c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:21:20 user nova-compute[74892]:   <uuid>a75e0d21-e9e0-4da9-a328-bac6aea1755c</uuid>
Nov 15 14:21:20 user nova-compute[74892]:   <name>instance-00000012</name>
Nov 15 14:21:20 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:21:20 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:21:20 user nova-compute[74892]:   <metadata>
Nov 15 14:21:20 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:21:20 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:21:20 user nova-compute[74892]:       <nova:name>tempest-VolumesNegativeTest-instance-1587713122</nova:name>
Nov 15 14:21:20 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:21:20</nova:creationTime>
Nov 15 14:21:20 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:21:20 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:21:20 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:21:20 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:21:20 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:21:20 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:21:20 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:21:20 user nova-compute[74892]:       <nova:owner>
Nov 15 14:21:20 user nova-compute[74892]:         <nova:user uuid="ca983885487f44c589101440835f1f98">tempest-VolumesNegativeTest-754367886-project-member</nova:user>
Nov 15 14:21:20 user nova-compute[74892]:         <nova:project uuid="4b56830838db45b1aa0621736a5ed53a">tempest-VolumesNegativeTest-754367886</nova:project>
Nov 15 14:21:20 user nova-compute[74892]:       </nova:owner>
Nov 15 14:21:20 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:21:20 user nova-compute[74892]:       <nova:ports>
Nov 15 14:21:20 user nova-compute[74892]:         <nova:port uuid="2b615c02-ce10-4a9f-8e2b-7a6bbc49170a">
Nov 15 14:21:20 user nova-compute[74892]:           <nova:ip type="fixed" address="192.168.233.236" ipVersion="4"/>
Nov 15 14:21:20 user nova-compute[74892]:         </nova:port>
Nov 15 14:21:20 user nova-compute[74892]:       </nova:ports>
Nov 15 14:21:20 user nova-compute[74892]:     </nova:instance>
Nov 15 14:21:20 user nova-compute[74892]:   </metadata>
Nov 15 14:21:20 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:21:20 user nova-compute[74892]:     <system>
Nov 15 14:21:20 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:21:20 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:21:20 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:21:20 user nova-compute[74892]:       <entry name="serial">a75e0d21-e9e0-4da9-a328-bac6aea1755c</entry>
Nov 15 14:21:20 user nova-compute[74892]:       <entry name="uuid">a75e0d21-e9e0-4da9-a328-bac6aea1755c</entry>
Nov 15 14:21:20 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:21:20 user nova-compute[74892]:     </system>
Nov 15 14:21:20 user nova-compute[74892]:   </sysinfo>
Nov 15 14:21:20 user nova-compute[74892]:   <os>
Nov 15 14:21:20 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:21:20 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:21:20 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:21:20 user nova-compute[74892]:   </os>
Nov 15 14:21:20 user nova-compute[74892]:   <features>
Nov 15 14:21:20 user nova-compute[74892]:     <acpi/>
Nov 15 14:21:20 user nova-compute[74892]:     <apic/>
Nov 15 14:21:20 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:21:20 user nova-compute[74892]:   </features>
Nov 15 14:21:20 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:21:20 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:21:20 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:21:20 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:21:20 user nova-compute[74892]:   </clock>
Nov 15 14:21:20 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:21:20 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:21:20 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:21:20 user nova-compute[74892]:   </cpu>
Nov 15 14:21:20 user nova-compute[74892]:   <devices>
Nov 15 14:21:20 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:21:20 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:21:20 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk"/>
Nov 15 14:21:20 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:21:20 user nova-compute[74892]:     </disk>
Nov 15 14:21:20 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:21:20 user nova-compute[74892]:       <mac address="fa:16:3e:41:e9:3e"/>
Nov 15 14:21:20 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:20 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:21:20 user nova-compute[74892]:       <target dev="tap2b615c02-ce"/>
Nov 15 14:21:20 user nova-compute[74892]:     </interface>
Nov 15 14:21:20 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:21:20 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/console.log" append="off"/>
Nov 15 14:21:20 user nova-compute[74892]:     </serial>
Nov 15 14:21:20 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:21:20 user nova-compute[74892]:     <video>
Nov 15 14:21:20 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:20 user nova-compute[74892]:     </video>
Nov 15 14:21:20 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:21:20 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:21:20 user nova-compute[74892]:     </rng>
Nov 15 14:21:20 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:21:20 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:21:20 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:21:20 user nova-compute[74892]:     </memballoon>
Nov 15 14:21:20 user nova-compute[74892]:   </devices>
Nov 15 14:21:20 user nova-compute[74892]: </domain>
Nov 15 14:21:20 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1587713122',display_name='tempest-VolumesNegativeTest-instance-1587713122',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1587713122',id=18,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b56830838db45b1aa0621736a5ed53a',ramdisk_id='',reservation_id='r-jk4a3uq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-754367886',owner_user_name='tempest-VolumesNegativeTest-754367886-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:17Z,user_data=None,user_id='ca983885487f44c589101440835f1f98',uuid=a75e0d21-e9e0-4da9-a328-bac6aea1755c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Converting VIF {"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e9:3e,bridge_name='br-int',has_traffic_filtering=True,id=2b615c02-ce10-4a9f-8e2b-7a6bbc49170a,network=Network(ac396435-1680-422d-9905-e9162b29c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b615c02-ce') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG os_vif [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e9:3e,bridge_name='br-int',has_traffic_filtering=True,id=2b615c02-ce10-4a9f-8e2b-7a6bbc49170a,network=Network(ac396435-1680-422d-9905-e9162b29c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b615c02-ce') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b358c9bb-a34e-52d3-b575-5eb37e118738', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b615c02-ce, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b615c02-ce, col_values=(('qos', UUID('0e2fd776-3118-4193-ae1f-fd4679c8c6a4')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b615c02-ce, col_values=(('external_ids', {'iface-id': '2b615c02-ce10-4a9f-8e2b-7a6bbc49170a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:e9:3e', 'vm-uuid': 'a75e0d21-e9e0-4da9-a328-bac6aea1755c'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:20 user nova-compute[74892]: INFO os_vif [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e9:3e,bridge_name='br-int',has_traffic_filtering=True,id=2b615c02-ce10-4a9f-8e2b-7a6bbc49170a,network=Network(ac396435-1680-422d-9905-e9162b29c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b615c02-ce')
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] No VIF found with MAC fa:16:3e:41:e9:3e, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.network.neutron [req-dadf4fa5-f08f-47ec-b9d1-a27770d9336e req-36dcfb10-9d94-4ce4-b6f2-35df47787c74 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Updated VIF entry in instance network info cache for port 2b615c02-ce10-4a9f-8e2b-7a6bbc49170a. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG nova.network.neutron [req-dadf4fa5-f08f-47ec-b9d1-a27770d9336e req-36dcfb10-9d94-4ce4-b6f2-35df47787c74 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Updating instance_info_cache with network_info: [{"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dadf4fa5-f08f-47ec-b9d1-a27770d9336e req-36dcfb10-9d94-4ce4-b6f2-35df47787c74 service nova] Releasing lock "refresh_cache-a75e0d21-e9e0-4da9-a328-bac6aea1755c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-180a7978-ef03-43bb-8bcc-0d1b6fcf9ced req-983ec1bd-4a4d-4658-a27c-b1fcf87bc0cf service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received event network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-180a7978-ef03-43bb-8bcc-0d1b6fcf9ced req-983ec1bd-4a4d-4658-a27c-b1fcf87bc0cf service nova] Acquiring lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-180a7978-ef03-43bb-8bcc-0d1b6fcf9ced req-983ec1bd-4a4d-4658-a27c-b1fcf87bc0cf service nova] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-180a7978-ef03-43bb-8bcc-0d1b6fcf9ced req-983ec1bd-4a4d-4658-a27c-b1fcf87bc0cf service nova] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-180a7978-ef03-43bb-8bcc-0d1b6fcf9ced req-983ec1bd-4a4d-4658-a27c-b1fcf87bc0cf service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] No waiting events found dispatching network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:22 user nova-compute[74892]: WARNING nova.compute.manager [req-180a7978-ef03-43bb-8bcc-0d1b6fcf9ced req-983ec1bd-4a4d-4658-a27c-b1fcf87bc0cf service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received unexpected event network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a for instance with vm_state building and task_state spawning.
Nov 15 14:21:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-f57b2aa1-c29e-4ce9-8a09-35997ee5bfa3 req-91936842-0582-44c8-8584-199badc108db service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received event network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f57b2aa1-c29e-4ce9-8a09-35997ee5bfa3 req-91936842-0582-44c8-8584-199badc108db service nova] Acquiring lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f57b2aa1-c29e-4ce9-8a09-35997ee5bfa3 req-91936842-0582-44c8-8584-199badc108db service nova] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f57b2aa1-c29e-4ce9-8a09-35997ee5bfa3 req-91936842-0582-44c8-8584-199badc108db service nova] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-f57b2aa1-c29e-4ce9-8a09-35997ee5bfa3 req-91936842-0582-44c8-8584-199badc108db service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] No waiting events found dispatching network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:24 user nova-compute[74892]: WARNING nova.compute.manager [req-f57b2aa1-c29e-4ce9-8a09-35997ee5bfa3 req-91936842-0582-44c8-8584-199badc108db service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received unexpected event network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a for instance with vm_state building and task_state spawning.
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:21:24 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Instance spawned successfully.
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:24 user nova-compute[74892]: INFO nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 15 14:21:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:21:24 user nova-compute[74892]: INFO nova.compute.manager [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Took 7.80 seconds to build instance.
Nov 15 14:21:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a9be9d06-dea1-4cf9-8161-c41ca299ca07 tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.910s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:29 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:21:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:29 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:21:29 user nova-compute[74892]: INFO nova.compute.claims [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Claim successful on node user
Nov 15 14:21:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.793s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:21:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.policy [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '577942c6b851420b9a197a950e116021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3146264c419041bb93c25b81c316b7c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:21:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Creating image(s)
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "/opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "/opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "/opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.285s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk 1073741824" returned: 0 in 0.052s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:31 user nova-compute[74892]: INFO nova.compute.manager [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Rescuing
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquired lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG nova.network.neutron [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Cannot resize image /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Ensure instance console log exists: /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Successfully created port: 02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating instance_info_cache with network_info: [{"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Releasing lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-a7c1888e-b0cd-49c0-83fe-aab10a8fe5f7 req-dd9d5d50-a072-4ef1-b100-4c33088b0397 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7c1888e-b0cd-49c0-83fe-aab10a8fe5f7 req-dd9d5d50-a072-4ef1-b100-4c33088b0397 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7c1888e-b0cd-49c0-83fe-aab10a8fe5f7 req-dd9d5d50-a072-4ef1-b100-4c33088b0397 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7c1888e-b0cd-49c0-83fe-aab10a8fe5f7 req-dd9d5d50-a072-4ef1-b100-4c33088b0397 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-a7c1888e-b0cd-49c0-83fe-aab10a8fe5f7 req-dd9d5d50-a072-4ef1-b100-4c33088b0397 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:32 user nova-compute[74892]: WARNING nova.compute.manager [req-a7c1888e-b0cd-49c0-83fe-aab10a8fe5f7 req-dd9d5d50-a072-4ef1-b100-4c33088b0397 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state rescuing.
Nov 15 14:21:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Successfully updated port: 02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "refresh_cache-7287af69-2562-4bc2-8a9f-e3cf3bb0814f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquired lock "refresh_cache-7287af69-2562-4bc2-8a9f-e3cf3bb0814f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance destroyed successfully.
Nov 15 14:21:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Attempting a stable device rescue
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Updating instance_info_cache with network_info: [{"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74892) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance directory exists: not creating {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 14:21:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Creating image(s)
Nov 15 14:21:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "/opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "/opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Releasing lock "refresh_cache-7287af69-2562-4bc2-8a9f-e3cf3bb0814f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Instance network_info: |[{"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Start _get_guest_xml network_info=[{"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:21:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "c48dae5ca0d60b22cc3272f039b58cdff47c6c56" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "c48dae5ca0d60b22cc3272f039b58cdff47c6c56" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1093685128',display_name='tempest-DeleteServersTestJSON-server-1093685128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1093685128',id=19,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3146264c419041bb93c25b81c316b7c7',ramdisk_id='',reservation_id='r-wlenvpn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-131353425',owner_user_name='tempest-DeleteServersTestJSON-131353425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:31Z,user_data=None,user_id='577942c6b851420b9a197a950e116021',uuid=7287af69-2562-4bc2-8a9f-e3cf3bb0814f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Converting VIF {"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:6e,bridge_name='br-int',has_traffic_filtering=True,id=02aa64ff-75e0-4dfa-80b9-32db327b1f5d,network=Network(6dd7861b-9458-49dc-84a3-43c9c99f4894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa64ff-75') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lazy-loading 'pci_devices' on Instance uuid 7287af69-2562-4bc2-8a9f-e3cf3bb0814f {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:21:33 user nova-compute[74892]:   <uuid>7287af69-2562-4bc2-8a9f-e3cf3bb0814f</uuid>
Nov 15 14:21:33 user nova-compute[74892]:   <name>instance-00000013</name>
Nov 15 14:21:33 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:21:33 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:21:33 user nova-compute[74892]:   <metadata>
Nov 15 14:21:33 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:21:33 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:21:33 user nova-compute[74892]:       <nova:name>tempest-DeleteServersTestJSON-server-1093685128</nova:name>
Nov 15 14:21:33 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:21:33</nova:creationTime>
Nov 15 14:21:33 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:21:33 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:21:33 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:21:33 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:21:33 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:21:33 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:21:33 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:21:33 user nova-compute[74892]:       <nova:owner>
Nov 15 14:21:33 user nova-compute[74892]:         <nova:user uuid="577942c6b851420b9a197a950e116021">tempest-DeleteServersTestJSON-131353425-project-member</nova:user>
Nov 15 14:21:33 user nova-compute[74892]:         <nova:project uuid="3146264c419041bb93c25b81c316b7c7">tempest-DeleteServersTestJSON-131353425</nova:project>
Nov 15 14:21:33 user nova-compute[74892]:       </nova:owner>
Nov 15 14:21:33 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:21:33 user nova-compute[74892]:       <nova:ports>
Nov 15 14:21:33 user nova-compute[74892]:         <nova:port uuid="02aa64ff-75e0-4dfa-80b9-32db327b1f5d">
Nov 15 14:21:33 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 14:21:33 user nova-compute[74892]:         </nova:port>
Nov 15 14:21:33 user nova-compute[74892]:       </nova:ports>
Nov 15 14:21:33 user nova-compute[74892]:     </nova:instance>
Nov 15 14:21:33 user nova-compute[74892]:   </metadata>
Nov 15 14:21:33 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:21:33 user nova-compute[74892]:     <system>
Nov 15 14:21:33 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:21:33 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:21:33 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:21:33 user nova-compute[74892]:       <entry name="serial">7287af69-2562-4bc2-8a9f-e3cf3bb0814f</entry>
Nov 15 14:21:33 user nova-compute[74892]:       <entry name="uuid">7287af69-2562-4bc2-8a9f-e3cf3bb0814f</entry>
Nov 15 14:21:33 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:21:33 user nova-compute[74892]:     </system>
Nov 15 14:21:33 user nova-compute[74892]:   </sysinfo>
Nov 15 14:21:33 user nova-compute[74892]:   <os>
Nov 15 14:21:33 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:21:33 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:21:33 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:21:33 user nova-compute[74892]:   </os>
Nov 15 14:21:33 user nova-compute[74892]:   <features>
Nov 15 14:21:33 user nova-compute[74892]:     <acpi/>
Nov 15 14:21:33 user nova-compute[74892]:     <apic/>
Nov 15 14:21:33 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:21:33 user nova-compute[74892]:   </features>
Nov 15 14:21:33 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:21:33 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:21:33 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:21:33 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:21:33 user nova-compute[74892]:   </clock>
Nov 15 14:21:33 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:21:33 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:21:33 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:21:33 user nova-compute[74892]:   </cpu>
Nov 15 14:21:33 user nova-compute[74892]:   <devices>
Nov 15 14:21:33 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:21:33 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:21:33 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk"/>
Nov 15 14:21:33 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:21:33 user nova-compute[74892]:     </disk>
Nov 15 14:21:33 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:21:33 user nova-compute[74892]:       <mac address="fa:16:3e:9e:ef:6e"/>
Nov 15 14:21:33 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:33 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:21:33 user nova-compute[74892]:       <target dev="tap02aa64ff-75"/>
Nov 15 14:21:33 user nova-compute[74892]:     </interface>
Nov 15 14:21:33 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:21:33 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/console.log" append="off"/>
Nov 15 14:21:33 user nova-compute[74892]:     </serial>
Nov 15 14:21:33 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:21:33 user nova-compute[74892]:     <video>
Nov 15 14:21:33 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:33 user nova-compute[74892]:     </video>
Nov 15 14:21:33 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:21:33 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:21:33 user nova-compute[74892]:     </rng>
Nov 15 14:21:33 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:21:33 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:21:33 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:21:33 user nova-compute[74892]:     </memballoon>
Nov 15 14:21:33 user nova-compute[74892]:   </devices>
Nov 15 14:21:33 user nova-compute[74892]: </domain>
Nov 15 14:21:33 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1093685128',display_name='tempest-DeleteServersTestJSON-server-1093685128',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1093685128',id=19,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3146264c419041bb93c25b81c316b7c7',ramdisk_id='',reservation_id='r-wlenvpn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-131353425',owner_user_name='tempest-DeleteServersTestJSON-131353425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:31Z,user_data=None,user_id='577942c6b851420b9a197a950e116021',uuid=7287af69-2562-4bc2-8a9f-e3cf3bb0814f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Converting VIF {"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:6e,bridge_name='br-int',has_traffic_filtering=True,id=02aa64ff-75e0-4dfa-80b9-32db327b1f5d,network=Network(6dd7861b-9458-49dc-84a3-43c9c99f4894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa64ff-75') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG os_vif [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:6e,bridge_name='br-int',has_traffic_filtering=True,id=02aa64ff-75e0-4dfa-80b9-32db327b1f5d,network=Network(6dd7861b-9458-49dc-84a3-43c9c99f4894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa64ff-75') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7142cd82-33af-5e27-8747-50a47a185b22', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02aa64ff-75, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02aa64ff-75, col_values=(('qos', UUID('6d9601b6-78fc-4423-bc0c-a3a8aa8cbf34')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02aa64ff-75, col_values=(('external_ids', {'iface-id': '02aa64ff-75e0-4dfa-80b9-32db327b1f5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:ef:6e', 'vm-uuid': '7287af69-2562-4bc2-8a9f-e3cf3bb0814f'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:33 user nova-compute[74892]: INFO os_vif [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:6e,bridge_name='br-int',has_traffic_filtering=True,id=02aa64ff-75e0-4dfa-80b9-32db327b1f5d,network=Network(6dd7861b-9458-49dc-84a3-43c9c99f4894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa64ff-75')
Nov 15 14:21:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Received event network-changed-02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Refreshing instance network info cache due to event network-changed-02aa64ff-75e0-4dfa-80b9-32db327b1f5d. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Acquiring lock "refresh_cache-7287af69-2562-4bc2-8a9f-e3cf3bb0814f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Acquired lock "refresh_cache-7287af69-2562-4bc2-8a9f-e3cf3bb0814f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Refreshing network info cache for port 02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] No VIF found with MAC fa:16:3e:9e:ef:6e, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56.part --force-share --output=json" returned: 0 in 0.213s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.images [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] c0b7fbb5-3f36-4edb-be07-b253dfe51ec8 was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56.part /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56.part /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56.converted" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "c48dae5ca0d60b22cc3272f039b58cdff47c6c56" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.988s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "c48dae5ca0d60b22cc3272f039b58cdff47c6c56" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "c48dae5ca0d60b22cc3272f039b58cdff47c6c56" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56 --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56 --force-share --output=json" returned: 0 in 0.203s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56,backing_fmt=raw /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.network.neutron [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Updated VIF entry in instance network info cache for port 02aa64ff-75e0-4dfa-80b9-32db327b1f5d. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.network.neutron [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Updating instance_info_cache with network_info: [{"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56,backing_fmt=raw /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue" returned: 0 in 0.051s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "c48dae5ca0d60b22cc3272f039b58cdff47c6c56" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'migration_context' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.objects.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<8fbd39df-d62a-4d1b-ac46-f0a2503a3987> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Start _get_guest_xml network_info=[{"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "vif_mac": "fa:16:3e:1e:a4:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c0b7fbb5-3f36-4edb-be07-b253dfe51ec8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdsOfZtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8fbd39df-d62a-4d1b-ac46-f0a2503a3987', 'attached_at': '', 'detached_at': '', 'volume_id': 'a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'serial': 'a7a39c82-65d7-46bd-a3ce-3ab2523326fe'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'f1d21131-9ee7-4336-90d4-0b8edea59f64', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'resources' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Releasing lock "refresh_cache-7287af69-2562-4bc2-8a9f-e3cf3bb0814f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:35 user nova-compute[74892]: WARNING nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state rescuing.
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:35 user nova-compute[74892]: WARNING nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state rescuing.
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:35 user nova-compute[74892]: WARNING nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state rescuing.
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:35 user nova-compute[74892]: WARNING nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state rescuing.
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:35 user nova-compute[74892]: WARNING nova.compute.manager [req-3cfef4be-1583-4d0e-a446-b2c09186a345 req-4e94351a-559d-4eef-8da4-ee5002dc4e30 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state rescuing.
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.objects.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<8fbd39df-d62a-4d1b-ac46-f0a2503a3987> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'numa_topology' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.objects.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<8fbd39df-d62a-4d1b-ac46-f0a2503a3987> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:21:35 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:35 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.objects.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<8fbd39df-d62a-4d1b-ac46-f0a2503a3987> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdsOfZtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:21:35 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:21:35 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:21:35 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[62217017-57fd-46f4-a305-7a602b0dea3e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = JdsOfZtL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 14:21:35 user nova-compute[74892]: node.name = iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:21:35 user nova-compute[74892]: node.tpgt = -1
Nov 15 14:21:35 user nova-compute[74892]: node.startup = automatic
Nov 15 14:21:35 user nova-compute[74892]: node.leading_login = No
Nov 15 14:21:35 user nova-compute[74892]: iface.iscsi_ifacename = default
Nov 15 14:21:35 user nova-compute[74892]: iface.net_ifacename = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.ipaddress = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.prefix_len = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.hwaddress = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.transport_name = tcp
Nov 15 14:21:35 user nova-compute[74892]: iface.initiatorname = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.state = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.vlan_id = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.vlan_priority = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.vlan_state = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.iface_num = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.mtu = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.port = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.bootproto = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.subnet_mask = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.gateway = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.dhcp_alt_client_id = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.dhcp_dns = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.dhcp_learn_iqn = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.dhcp_vendor_id_state = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.dhcp_vendor_id = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.dhcp_slp_da = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.fragmentation = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.gratuitous_arp = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.incoming_forwarding = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.tos_state = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.tos = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.ttl = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.delayed_ack = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.tcp_nagle = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.tcp_wsf_state = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.tcp_wsf = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.tcp_timer_scale = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.tcp_timestamp = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.redirect = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.def_task_mgmt_timeout = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.header_digest = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.data_digest = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.immediate_data = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.initial_r2t = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.data_seq_inorder = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.data_pdu_inorder = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.erl = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.max_receive_data_len = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.first_burst_len = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.max_outstanding_r2t = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.max_burst_len = 0
Nov 15 14:21:35 user nova-compute[74892]: iface.chap_auth = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.bidi_chap = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.strict_login_compliance = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.discovery_auth = <empty>
Nov 15 14:21:35 user nova-compute[74892]: iface.discovery_logout = <empty>
Nov 15 14:21:35 user nova-compute[74892]: node.discovery_address = <empty>
Nov 15 14:21:35 user nova-compute[74892]: node.discovery_port = 0
Nov 15 14:21:35 user nova-compute[74892]: node.discovery_type = static
Nov 15 14:21:35 user nova-compute[74892]: node.session.initial_cmdsn = 0
Nov 15 14:21:35 user nova-compute[74892]: node.session.initial_login_retry_max = 8
Nov 15 14:21:35 user nova-compute[74892]: node.session.xmit_thread_priority = -20
Nov 15 14:21:35 user nova-compute[74892]: node.session.cmds_max = 128
Nov 15 14:21:35 user nova-compute[74892]: node.session.queue_depth = 32
Nov 15 14:21:35 user nova-compute[74892]: node.session.nr_sessions = 1
Nov 15 14:21:35 user nova-compute[74892]: node.session.auth.authmethod = CHAP
Nov 15 14:21:35 user nova-compute[74892]: node.session.auth.username = JdsOfZtL
Nov 15 14:21:35 user nova-compute[74892]: node.session.auth.password = ***
Nov 15 14:21:35 user nova-compute[74892]: node.session.auth.username_in = <empty>
Nov 15 14:21:35 user nova-compute[74892]: node.session.auth.password_in = <empty>
Nov 15 14:21:35 user nova-compute[74892]: node.session.auth.chap_algs = MD5
Nov 15 14:21:35 user nova-compute[74892]: node.session.timeo.replacement_timeout = 120
Nov 15 14:21:35 user nova-compute[74892]: node.session.err_timeo.abort_timeout = 15
Nov 15 14:21:35 user nova-compute[74892]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 14:21:35 user nova-compute[74892]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 14:21:35 user nova-compute[74892]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.FastAbort = Yes
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.InitialR2T = No
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.ImmediateData = Yes
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.MaxConnections = 1
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 14:21:35 user nova-compute[74892]: node.session.iscsi.ERL = 0
Nov 15 14:21:35 user nova-compute[74892]: node.session.scan = manual
Nov 15 14:21:35 user nova-compute[74892]: node.session.reopen_max = 0
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].address = 172.16.0.220
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].port = 3260
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].startup = manual
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].tcp.window_size = 524288
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].tcp.type_of_service = 0
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].timeo.logout_timeout = 15
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].timeo.login_timeout = 15
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].timeo.auth_timeout = 45
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].iscsi.DataDigest = None
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].iscsi.IFMarker = No
Nov 15 14:21:35 user nova-compute[74892]: node.conn[0].iscsi.OFMarker = No
Nov 15 14:21:35 user nova-compute[74892]: # END RECORD
Nov 15 14:21:35 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[84420758-bbbf-451f-b524-6cd6192fe70d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[697bb3e9-007f-4191-927c-2fe4663c5888]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdsOfZtL {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JdsOfZtL" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[54727e94-212b-4dac-83d7-5486c4eb027a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JdsOfZtL'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7abc2e8-b1e5-4733-8ee7-5220d0e31950]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:21:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4857c10-57b4-4f53-a4f3-a0150066da7c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:21:36 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:21:36 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:21:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:21:36 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:21:36 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:21:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] HCTL ('35', '0', '0', 0) found on session 15 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a989ad3-71dc-4a15-8c31-fe022ca0f412]: (4, ('0 0 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching for a device in session 15 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdsOfZtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.203s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] <== connect_volume: return (204ms) {'type': 'block', 'scsi_wwn': '23866366338633664', 'path': '/dev/sdd'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866366338633664', 'path': '/dev/sdd'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670851347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670851347',id=13,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:19:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-b2mcwnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:19:57Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=8fbd39df-d62a-4d1b-ac46-f0a2503a3987,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "vif_mac": "fa:16:3e:1e:a4:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "vif_mac": "fa:16:3e:1e:a4:af"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a4:af,bridge_name='br-int',has_traffic_filtering=True,id=d605c970-50ca-4127-bae5-c19aa1a429e0,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd605c970-50') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.objects.instance [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.objects.base [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<8fbd39df-d62a-4d1b-ac46-f0a2503a3987> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:21:36 user nova-compute[74892]:   <uuid>8fbd39df-d62a-4d1b-ac46-f0a2503a3987</uuid>
Nov 15 14:21:36 user nova-compute[74892]:   <name>instance-0000000d</name>
Nov 15 14:21:36 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:21:36 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:21:36 user nova-compute[74892]:   <metadata>
Nov 15 14:21:36 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:21:36 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:21:36 user nova-compute[74892]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1670851347</nova:name>
Nov 15 14:21:36 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:21:35</nova:creationTime>
Nov 15 14:21:36 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:21:36 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:21:36 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:21:36 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:21:36 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:21:36 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:21:36 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:21:36 user nova-compute[74892]:       <nova:owner>
Nov 15 14:21:36 user nova-compute[74892]:         <nova:user uuid="eccd14bd0c974f4a83aba63fd70df073">tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member</nova:user>
Nov 15 14:21:36 user nova-compute[74892]:         <nova:project uuid="3fcc169292ce42fb9f54aab1db3869bd">tempest-ServerBootFromVolumeStableRescueTest-760148567</nova:project>
Nov 15 14:21:36 user nova-compute[74892]:       </nova:owner>
Nov 15 14:21:36 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:21:36 user nova-compute[74892]:       <nova:ports>
Nov 15 14:21:36 user nova-compute[74892]:         <nova:port uuid="d605c970-50ca-4127-bae5-c19aa1a429e0">
Nov 15 14:21:36 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 14:21:36 user nova-compute[74892]:         </nova:port>
Nov 15 14:21:36 user nova-compute[74892]:       </nova:ports>
Nov 15 14:21:36 user nova-compute[74892]:     </nova:instance>
Nov 15 14:21:36 user nova-compute[74892]:   </metadata>
Nov 15 14:21:36 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:21:36 user nova-compute[74892]:     <system>
Nov 15 14:21:36 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:21:36 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:21:36 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:21:36 user nova-compute[74892]:       <entry name="serial">8fbd39df-d62a-4d1b-ac46-f0a2503a3987</entry>
Nov 15 14:21:36 user nova-compute[74892]:       <entry name="uuid">8fbd39df-d62a-4d1b-ac46-f0a2503a3987</entry>
Nov 15 14:21:36 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:21:36 user nova-compute[74892]:     </system>
Nov 15 14:21:36 user nova-compute[74892]:   </sysinfo>
Nov 15 14:21:36 user nova-compute[74892]:   <os>
Nov 15 14:21:36 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:21:36 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:21:36 user nova-compute[74892]:   </os>
Nov 15 14:21:36 user nova-compute[74892]:   <features>
Nov 15 14:21:36 user nova-compute[74892]:     <acpi/>
Nov 15 14:21:36 user nova-compute[74892]:     <apic/>
Nov 15 14:21:36 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:21:36 user nova-compute[74892]:   </features>
Nov 15 14:21:36 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:21:36 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:21:36 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:21:36 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:21:36 user nova-compute[74892]:   </clock>
Nov 15 14:21:36 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:21:36 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:21:36 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:21:36 user nova-compute[74892]:   </cpu>
Nov 15 14:21:36 user nova-compute[74892]:   <devices>
Nov 15 14:21:36 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:21:36 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:21:36 user nova-compute[74892]:       <source dev="/dev/sdd"/>
Nov 15 14:21:36 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:21:36 user nova-compute[74892]:       <serial>a7a39c82-65d7-46bd-a3ce-3ab2523326fe</serial>
Nov 15 14:21:36 user nova-compute[74892]:     </disk>
Nov 15 14:21:36 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:21:36 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:21:36 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue"/>
Nov 15 14:21:36 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:21:36 user nova-compute[74892]:       <boot order="1"/>
Nov 15 14:21:36 user nova-compute[74892]:     </disk>
Nov 15 14:21:36 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:21:36 user nova-compute[74892]:       <mac address="fa:16:3e:1e:a4:af"/>
Nov 15 14:21:36 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:36 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:21:36 user nova-compute[74892]:       <target dev="tapd605c970-50"/>
Nov 15 14:21:36 user nova-compute[74892]:     </interface>
Nov 15 14:21:36 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:21:36 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/console.log" append="off"/>
Nov 15 14:21:36 user nova-compute[74892]:     </serial>
Nov 15 14:21:36 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:21:36 user nova-compute[74892]:     <video>
Nov 15 14:21:36 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:36 user nova-compute[74892]:     </video>
Nov 15 14:21:36 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:21:36 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:21:36 user nova-compute[74892]:     </rng>
Nov 15 14:21:36 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:21:36 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:21:36 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:21:36 user nova-compute[74892]:     </memballoon>
Nov 15 14:21:36 user nova-compute[74892]:   </devices>
Nov 15 14:21:36 user nova-compute[74892]: </domain>
Nov 15 14:21:36 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:21:36 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance destroyed successfully.
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No VIF found with MAC fa:16:3e:1e:a4:af, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-2503e6fc-635d-49b3-baa2-304fc971efa4 req-af3dd836-8712-4c8d-a63d-26045da6e116 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Received event network-vif-plugged-02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2503e6fc-635d-49b3-baa2-304fc971efa4 req-af3dd836-8712-4c8d-a63d-26045da6e116 service nova] Acquiring lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2503e6fc-635d-49b3-baa2-304fc971efa4 req-af3dd836-8712-4c8d-a63d-26045da6e116 service nova] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2503e6fc-635d-49b3-baa2-304fc971efa4 req-af3dd836-8712-4c8d-a63d-26045da6e116 service nova] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-2503e6fc-635d-49b3-baa2-304fc971efa4 req-af3dd836-8712-4c8d-a63d-26045da6e116 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] No waiting events found dispatching network-vif-plugged-02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:36 user nova-compute[74892]: WARNING nova.compute.manager [req-2503e6fc-635d-49b3-baa2-304fc971efa4 req-af3dd836-8712-4c8d-a63d-26045da6e116 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Received unexpected event network-vif-plugged-02aa64ff-75e0-4dfa-80b9-32db327b1f5d for instance with vm_state building and task_state spawning.
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:21:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-83a0e8c0-946d-43cb-a7e4-6e1eeef09a0e req-c7c46020-3433-49ab-bf8a-301dd6cf5302 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-83a0e8c0-946d-43cb-a7e4-6e1eeef09a0e req-c7c46020-3433-49ab-bf8a-301dd6cf5302 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-83a0e8c0-946d-43cb-a7e4-6e1eeef09a0e req-c7c46020-3433-49ab-bf8a-301dd6cf5302 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-83a0e8c0-946d-43cb-a7e4-6e1eeef09a0e req-c7c46020-3433-49ab-bf8a-301dd6cf5302 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-83a0e8c0-946d-43cb-a7e4-6e1eeef09a0e req-c7c46020-3433-49ab-bf8a-301dd6cf5302 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:38 user nova-compute[74892]: WARNING nova.compute.manager [req-83a0e8c0-946d-43cb-a7e4-6e1eeef09a0e req-c7c46020-3433-49ab-bf8a-301dd6cf5302 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state rescuing.
Nov 15 14:21:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-b3f81b0f-8069-4b94-82a9-cfc79105feed req-5556ad77-c847-4202-828d-7886804ca4b1 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Received event network-vif-plugged-02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b3f81b0f-8069-4b94-82a9-cfc79105feed req-5556ad77-c847-4202-828d-7886804ca4b1 service nova] Acquiring lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b3f81b0f-8069-4b94-82a9-cfc79105feed req-5556ad77-c847-4202-828d-7886804ca4b1 service nova] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b3f81b0f-8069-4b94-82a9-cfc79105feed req-5556ad77-c847-4202-828d-7886804ca4b1 service nova] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-b3f81b0f-8069-4b94-82a9-cfc79105feed req-5556ad77-c847-4202-828d-7886804ca4b1 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] No waiting events found dispatching network-vif-plugged-02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:38 user nova-compute[74892]: WARNING nova.compute.manager [req-b3f81b0f-8069-4b94-82a9-cfc79105feed req-5556ad77-c847-4202-828d-7886804ca4b1 service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Received unexpected event network-vif-plugged-02aa64ff-75e0-4dfa-80b9-32db327b1f5d for instance with vm_state building and task_state spawning.
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:21:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:21:39 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Instance spawned successfully.
Nov 15 14:21:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:40 user nova-compute[74892]: INFO nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Took 9.48 seconds to spawn the instance on the hypervisor.
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:40 user nova-compute[74892]: INFO nova.compute.manager [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Took 10.69 seconds to build instance.
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bc1146af-c40f-40da-9353-6aa5f48ca0c3 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.840s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-22865002-bfe3-43ab-a7da-9cf053833bff tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-2fe7a3c8-174b-4d99-9277-7952281e9a18 req-b7a25814-4d21-42e5-84ef-f2fd1038cf4a service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fe7a3c8-174b-4d99-9277-7952281e9a18 req-b7a25814-4d21-42e5-84ef-f2fd1038cf4a service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fe7a3c8-174b-4d99-9277-7952281e9a18 req-b7a25814-4d21-42e5-84ef-f2fd1038cf4a service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fe7a3c8-174b-4d99-9277-7952281e9a18 req-b7a25814-4d21-42e5-84ef-f2fd1038cf4a service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-2fe7a3c8-174b-4d99-9277-7952281e9a18 req-b7a25814-4d21-42e5-84ef-f2fd1038cf4a service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:40 user nova-compute[74892]: WARNING nova.compute.manager [req-2fe7a3c8-174b-4d99-9277-7952281e9a18 req-b7a25814-4d21-42e5-84ef-f2fd1038cf4a service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state rescuing.
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7161MB free_disk=25.222427368164062GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Applying migration context for instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 as it has an incoming, in-progress migration e4805810-9284-482a-b3c2-8dd87bbad9a9. Migration status is finished {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 14:21:44 user nova-compute[74892]: INFO nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating resource usage from migration e4805810-9284-482a-b3c2-8dd87bbad9a9
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a038db7d-023b-44ac-a74e-be018b0b6492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ce081593-37a3-49bf-9bf0-a9a6f7aba337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 84b93526-cf57-4c07-ac77-9ae6ab68cf01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 726e0f64-5808-4e5b-accf-190ed1537b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Migration e4805810-9284-482a-b3c2-8dd87bbad9a9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a75e0d21-e9e0-4da9-a328-bac6aea1755c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 7287af69-2562-4bc2-8a9f-e3cf3bb0814f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:21:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:21:45 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:45 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:21:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:21:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:21:46 user nova-compute[74892]: INFO nova.compute.claims [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Claim successful on node user
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:47 user nova-compute[74892]: INFO nova.compute.manager [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Terminating instance
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-e981c662-9ea1-49ed-8df8-dc1796c780dc req-8d46eaff-79e4-4572-9c26-73aa0c690c7f service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received event network-vif-unplugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e981c662-9ea1-49ed-8df8-dc1796c780dc req-8d46eaff-79e4-4572-9c26-73aa0c690c7f service nova] Acquiring lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e981c662-9ea1-49ed-8df8-dc1796c780dc req-8d46eaff-79e4-4572-9c26-73aa0c690c7f service nova] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e981c662-9ea1-49ed-8df8-dc1796c780dc req-8d46eaff-79e4-4572-9c26-73aa0c690c7f service nova] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-e981c662-9ea1-49ed-8df8-dc1796c780dc req-8d46eaff-79e4-4572-9c26-73aa0c690c7f service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] No waiting events found dispatching network-vif-unplugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-e981c662-9ea1-49ed-8df8-dc1796c780dc req-8d46eaff-79e4-4572-9c26-73aa0c690c7f service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received event network-vif-unplugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.901s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:21:47 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:21:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:21:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Creating image(s)
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "/opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "/opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "/opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Instance destroyed successfully.
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.objects.instance [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lazy-loading 'resources' on Instance uuid ce081593-37a3-49bf-9bf0-a9a6f7aba337 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-373577490',display_name='tempest-VolumesActionsTest-instance-373577490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-373577490',id=14,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:20:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='24aea1db854c42c0aa85018c5518b0a5',ramdisk_id='',reservation_id='r-tnsn8tho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1307238287',owner_user_name='tempest-VolumesActionsTest-1307238287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:20:03Z,user_data=None,user_id='99f4ed77744d4cdb80cca826b6dc50b9',uuid=ce081593-37a3-49bf-9bf0-a9a6f7aba337,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converting VIF {"id": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "address": "fa:16:3e:50:cc:6e", "network": {"id": "cedf21ec-0e1e-4125-8448-2edfc76d1f67", "bridge": "br-int", "label": "tempest-VolumesActionsTest-508147743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "24aea1db854c42c0aa85018c5518b0a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7b0fae2-b0", "ovs_interfaceid": "d7b0fae2-b0dc-49ce-b211-464a83f0a5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:cc:6e,bridge_name='br-int',has_traffic_filtering=True,id=d7b0fae2-b0dc-49ce-b211-464a83f0a5a0,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7b0fae2-b0') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG os_vif [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:cc:6e,bridge_name='br-int',has_traffic_filtering=True,id=d7b0fae2-b0dc-49ce-b211-464a83f0a5a0,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7b0fae2-b0') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7b0fae2-b0, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8752b16d-8a6d-4c89-878e-817cf55c1368) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:48 user nova-compute[74892]: INFO os_vif [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:cc:6e,bridge_name='br-int',has_traffic_filtering=True,id=d7b0fae2-b0dc-49ce-b211-464a83f0a5a0,network=Network(cedf21ec-0e1e-4125-8448-2edfc76d1f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7b0fae2-b0')
Nov 15 14:21:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Deleting instance files /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337_del
Nov 15 14:21:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Deletion of /opt/stack/data/nova/instances/ce081593-37a3-49bf-9bf0-a9a6f7aba337_del complete
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.policy [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '494e2c6ede5c47ed8af6d1399ad8a06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d5b81e2d940589392aa33ffb900e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:21:48 user nova-compute[74892]: INFO nova.compute.manager [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.207s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk 1073741824" returned: 0 in 0.056s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Cannot resize image /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:21:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Ensure instance console log exists: /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Successfully created port: 65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:21:49 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Took 1.15 seconds to deallocate network for instance.
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-75bcf018-5a84-4309-9097-e7bbd8907409 req-5164d42e-d2f1-4efa-8345-b095e706409d service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received event network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75bcf018-5a84-4309-9097-e7bbd8907409 req-5164d42e-d2f1-4efa-8345-b095e706409d service nova] Acquiring lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75bcf018-5a84-4309-9097-e7bbd8907409 req-5164d42e-d2f1-4efa-8345-b095e706409d service nova] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75bcf018-5a84-4309-9097-e7bbd8907409 req-5164d42e-d2f1-4efa-8345-b095e706409d service nova] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-75bcf018-5a84-4309-9097-e7bbd8907409 req-5164d42e-d2f1-4efa-8345-b095e706409d service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] No waiting events found dispatching network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:49 user nova-compute[74892]: WARNING nova.compute.manager [req-75bcf018-5a84-4309-9097-e7bbd8907409 req-5164d42e-d2f1-4efa-8345-b095e706409d service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received unexpected event network-vif-plugged-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 for instance with vm_state deleted and task_state None.
Nov 15 14:21:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-75bcf018-5a84-4309-9097-e7bbd8907409 req-5164d42e-d2f1-4efa-8345-b095e706409d service nova] [instance: ce081593-37a3-49bf-9bf0-a9a6f7aba337] Received event network-vif-deleted-d7b0fae2-b0dc-49ce-b211-464a83f0a5a0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:50 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:50 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.665s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:50 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Deleted allocations for instance ce081593-37a3-49bf-9bf0-a9a6f7aba337
Nov 15 14:21:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d9f7fd7-9b3c-4607-bbb5-8ab0430fc64d tempest-VolumesActionsTest-1307238287 tempest-VolumesActionsTest-1307238287-project-member] Lock "ce081593-37a3-49bf-9bf0-a9a6f7aba337" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.076s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Successfully updated port: 65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquired lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-24629bf8-b423-4f61-8157-96a47f671d1c req-34d9784d-124b-402b-8186-2349ce5cae9f service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received event network-changed-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-24629bf8-b423-4f61-8157-96a47f671d1c req-34d9784d-124b-402b-8186-2349ce5cae9f service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Refreshing instance network info cache due to event network-changed-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-24629bf8-b423-4f61-8157-96a47f671d1c req-34d9784d-124b-402b-8186-2349ce5cae9f service nova] Acquiring lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Updating instance_info_cache with network_info: [{"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Releasing lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Instance network_info: |[{"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-24629bf8-b423-4f61-8157-96a47f671d1c req-34d9784d-124b-402b-8186-2349ce5cae9f service nova] Acquired lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.neutron [req-24629bf8-b423-4f61-8157-96a47f671d1c req-34d9784d-124b-402b-8186-2349ce5cae9f service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Refreshing network info cache for port 65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Start _get_guest_xml network_info=[{"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:21:51 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:51 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88780013',display_name='tempest-AttachVolumeNegativeTest-server-88780013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-88780013',id=20,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcgnijwv8Jp5M3JyZq4t7NrTkFyrxrAK6Z6m50/ZI4y77gd9sgNzRuS9Gwww84hJErXN/yL5vfGjFVVNPKYZsP3d3Y3fSGVfGY1uDKDhBJjDqXmyTBbIBI/olwnrNAnUg==',key_name='tempest-keypair-1734118793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-aw4r6tfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=d013f581-2c2a-4935-98d5-53b0904118ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:17:f7,bridge_name='br-int',has_traffic_filtering=True,id=65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a4e6c3-62') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'pci_devices' on Instance uuid d013f581-2c2a-4935-98d5-53b0904118ac {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:21:51 user nova-compute[74892]:   <uuid>d013f581-2c2a-4935-98d5-53b0904118ac</uuid>
Nov 15 14:21:51 user nova-compute[74892]:   <name>instance-00000014</name>
Nov 15 14:21:51 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:21:51 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:21:51 user nova-compute[74892]:   <metadata>
Nov 15 14:21:51 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:21:51 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:21:51 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeNegativeTest-server-88780013</nova:name>
Nov 15 14:21:51 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:21:51</nova:creationTime>
Nov 15 14:21:51 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:21:51 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:21:51 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:21:51 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:21:51 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:21:51 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:21:51 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:21:51 user nova-compute[74892]:       <nova:owner>
Nov 15 14:21:51 user nova-compute[74892]:         <nova:user uuid="494e2c6ede5c47ed8af6d1399ad8a06a">tempest-AttachVolumeNegativeTest-2132166828-project-member</nova:user>
Nov 15 14:21:51 user nova-compute[74892]:         <nova:project uuid="6c2d5b81e2d940589392aa33ffb900e2">tempest-AttachVolumeNegativeTest-2132166828</nova:project>
Nov 15 14:21:51 user nova-compute[74892]:       </nova:owner>
Nov 15 14:21:51 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:21:51 user nova-compute[74892]:       <nova:ports>
Nov 15 14:21:51 user nova-compute[74892]:         <nova:port uuid="65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce">
Nov 15 14:21:51 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:21:51 user nova-compute[74892]:         </nova:port>
Nov 15 14:21:51 user nova-compute[74892]:       </nova:ports>
Nov 15 14:21:51 user nova-compute[74892]:     </nova:instance>
Nov 15 14:21:51 user nova-compute[74892]:   </metadata>
Nov 15 14:21:51 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:21:51 user nova-compute[74892]:     <system>
Nov 15 14:21:51 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:21:51 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:21:51 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:21:51 user nova-compute[74892]:       <entry name="serial">d013f581-2c2a-4935-98d5-53b0904118ac</entry>
Nov 15 14:21:51 user nova-compute[74892]:       <entry name="uuid">d013f581-2c2a-4935-98d5-53b0904118ac</entry>
Nov 15 14:21:51 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:21:51 user nova-compute[74892]:     </system>
Nov 15 14:21:51 user nova-compute[74892]:   </sysinfo>
Nov 15 14:21:51 user nova-compute[74892]:   <os>
Nov 15 14:21:51 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:21:51 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:21:51 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:21:51 user nova-compute[74892]:   </os>
Nov 15 14:21:51 user nova-compute[74892]:   <features>
Nov 15 14:21:51 user nova-compute[74892]:     <acpi/>
Nov 15 14:21:51 user nova-compute[74892]:     <apic/>
Nov 15 14:21:51 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:21:51 user nova-compute[74892]:   </features>
Nov 15 14:21:51 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:21:51 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:21:51 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:21:51 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:21:51 user nova-compute[74892]:   </clock>
Nov 15 14:21:51 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:21:51 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:21:51 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:21:51 user nova-compute[74892]:   </cpu>
Nov 15 14:21:51 user nova-compute[74892]:   <devices>
Nov 15 14:21:51 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:21:51 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:21:51 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk"/>
Nov 15 14:21:51 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:21:51 user nova-compute[74892]:     </disk>
Nov 15 14:21:51 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:21:51 user nova-compute[74892]:       <mac address="fa:16:3e:d9:17:f7"/>
Nov 15 14:21:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:51 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:21:51 user nova-compute[74892]:       <target dev="tap65a4e6c3-62"/>
Nov 15 14:21:51 user nova-compute[74892]:     </interface>
Nov 15 14:21:51 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:21:51 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/console.log" append="off"/>
Nov 15 14:21:51 user nova-compute[74892]:     </serial>
Nov 15 14:21:51 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:21:51 user nova-compute[74892]:     <video>
Nov 15 14:21:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:51 user nova-compute[74892]:     </video>
Nov 15 14:21:51 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:21:51 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:21:51 user nova-compute[74892]:     </rng>
Nov 15 14:21:51 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:21:51 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:21:51 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:21:51 user nova-compute[74892]:     </memballoon>
Nov 15 14:21:51 user nova-compute[74892]:   </devices>
Nov 15 14:21:51 user nova-compute[74892]: </domain>
Nov 15 14:21:51 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88780013',display_name='tempest-AttachVolumeNegativeTest-server-88780013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-88780013',id=20,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcgnijwv8Jp5M3JyZq4t7NrTkFyrxrAK6Z6m50/ZI4y77gd9sgNzRuS9Gwww84hJErXN/yL5vfGjFVVNPKYZsP3d3Y3fSGVfGY1uDKDhBJjDqXmyTBbIBI/olwnrNAnUg==',key_name='tempest-keypair-1734118793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-aw4r6tfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=d013f581-2c2a-4935-98d5-53b0904118ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:17:f7,bridge_name='br-int',has_traffic_filtering=True,id=65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a4e6c3-62') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG os_vif [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:17:f7,bridge_name='br-int',has_traffic_filtering=True,id=65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a4e6c3-62') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f9d9469-2beb-53f4-aa57-91ff31a976aa', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65a4e6c3-62, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65a4e6c3-62, col_values=(('qos', UUID('92fd051f-dd2b-4b28-9772-9df35fd167d6')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65a4e6c3-62, col_values=(('external_ids', {'iface-id': '65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:17:f7', 'vm-uuid': 'd013f581-2c2a-4935-98d5-53b0904118ac'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:51 user nova-compute[74892]: INFO os_vif [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:17:f7,bridge_name='br-int',has_traffic_filtering=True,id=65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a4e6c3-62')
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No VIF found with MAC fa:16:3e:d9:17:f7, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:21:52 user nova-compute[74892]: DEBUG nova.network.neutron [req-24629bf8-b423-4f61-8157-96a47f671d1c req-34d9784d-124b-402b-8186-2349ce5cae9f service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Updated VIF entry in instance network info cache for port 65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:21:52 user nova-compute[74892]: DEBUG nova.network.neutron [req-24629bf8-b423-4f61-8157-96a47f671d1c req-34d9784d-124b-402b-8186-2349ce5cae9f service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Updating instance_info_cache with network_info: [{"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-24629bf8-b423-4f61-8157-96a47f671d1c req-34d9784d-124b-402b-8186-2349ce5cae9f service nova] Releasing lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-547988b0-12b3-43a7-8c3f-54b7624be97f req-e3d03815-b8aa-4c7d-8bfa-223102579f08 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received event network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-547988b0-12b3-43a7-8c3f-54b7624be97f req-e3d03815-b8aa-4c7d-8bfa-223102579f08 service nova] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-547988b0-12b3-43a7-8c3f-54b7624be97f req-e3d03815-b8aa-4c7d-8bfa-223102579f08 service nova] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-547988b0-12b3-43a7-8c3f-54b7624be97f req-e3d03815-b8aa-4c7d-8bfa-223102579f08 service nova] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-547988b0-12b3-43a7-8c3f-54b7624be97f req-e3d03815-b8aa-4c7d-8bfa-223102579f08 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] No waiting events found dispatching network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:53 user nova-compute[74892]: WARNING nova.compute.manager [req-547988b0-12b3-43a7-8c3f-54b7624be97f req-e3d03815-b8aa-4c7d-8bfa-223102579f08 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received unexpected event network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce for instance with vm_state building and task_state spawning.
Nov 15 14:21:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:55 user nova-compute[74892]: INFO nova.compute.manager [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Terminating instance
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-3455ccc0-6387-4c6f-8327-2e05866df38c req-2159e926-22d1-4c5d-9382-11fe0210cb21 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received event network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3455ccc0-6387-4c6f-8327-2e05866df38c req-2159e926-22d1-4c5d-9382-11fe0210cb21 service nova] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3455ccc0-6387-4c6f-8327-2e05866df38c req-2159e926-22d1-4c5d-9382-11fe0210cb21 service nova] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3455ccc0-6387-4c6f-8327-2e05866df38c req-2159e926-22d1-4c5d-9382-11fe0210cb21 service nova] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-3455ccc0-6387-4c6f-8327-2e05866df38c req-2159e926-22d1-4c5d-9382-11fe0210cb21 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] No waiting events found dispatching network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:55 user nova-compute[74892]: WARNING nova.compute.manager [req-3455ccc0-6387-4c6f-8327-2e05866df38c req-2159e926-22d1-4c5d-9382-11fe0210cb21 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received unexpected event network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce for instance with vm_state building and task_state spawning.
Nov 15 14:21:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:21:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Instance spawned successfully.
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:21:56 user nova-compute[74892]: INFO nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Took 8.18 seconds to spawn the instance on the hypervisor.
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:21:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Instance destroyed successfully.
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.objects.instance [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lazy-loading 'resources' on Instance uuid 84b93526-cf57-4c07-ac77-9ae6ab68cf01 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-806146840',display_name='tempest-VolumesAdminNegativeTest-server-806146840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-806146840',id=15,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:20:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ed8813ce754c82b8abaa69a5e509f1',ramdisk_id='',reservation_id='r-e81fc13v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1173866799',owner_user_name='tempest-VolumesAdminNegativeTest-1173866799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:20:07Z,user_data=None,user_id='5945249c9efe4a40980557b4aba1d0da',uuid=84b93526-cf57-4c07-ac77-9ae6ab68cf01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converting VIF {"id": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "address": "fa:16:3e:59:91:5a", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f32e4c9-a0", "ovs_interfaceid": "2f32e4c9-a025-4eca-978a-12792cdec0a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:91:5a,bridge_name='br-int',has_traffic_filtering=True,id=2f32e4c9-a025-4eca-978a-12792cdec0a5,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f32e4c9-a0') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG os_vif [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:91:5a,bridge_name='br-int',has_traffic_filtering=True,id=2f32e4c9-a025-4eca-978a-12792cdec0a5,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f32e4c9-a0') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f32e4c9-a0, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a431cd05-266f-4b43-8664-61649d3fc57a) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:56 user nova-compute[74892]: INFO os_vif [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:91:5a,bridge_name='br-int',has_traffic_filtering=True,id=2f32e4c9-a025-4eca-978a-12792cdec0a5,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f32e4c9-a0')
Nov 15 14:21:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Deleting instance files /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01_del
Nov 15 14:21:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Deletion of /opt/stack/data/nova/instances/84b93526-cf57-4c07-ac77-9ae6ab68cf01_del complete
Nov 15 14:21:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:21:56 user nova-compute[74892]: INFO nova.compute.claims [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Claim successful on node user
Nov 15 14:21:56 user nova-compute[74892]: INFO nova.compute.manager [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Took 9.50 seconds to build instance.
Nov 15 14:21:56 user nova-compute[74892]: INFO nova.compute.manager [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 14:21:56 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:21:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3732370a-23a2-42ec-8e64-4036fa33d507 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.629s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:21:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:21:57 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Took 0.68 seconds to deallocate network for instance.
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.policy [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2d08093aaa041d19f085ff9b5f822db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0ace93cdac442c087c0ee565ce6d91f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:21:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Creating image(s)
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.235s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received event network-vif-unplugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] Acquiring lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] No waiting events found dispatching network-vif-unplugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:57 user nova-compute[74892]: WARNING nova.compute.manager [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received unexpected event network-vif-unplugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 for instance with vm_state deleted and task_state None.
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received event network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] Acquiring lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] No waiting events found dispatching network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:21:57 user nova-compute[74892]: WARNING nova.compute.manager [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received unexpected event network-vif-plugged-2f32e4c9-a025-4eca-978a-12792cdec0a5 for instance with vm_state deleted and task_state None.
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-47ab2f9f-a796-4348-8a52-003a49e26550 req-667d2805-ca69-4d15-9e8e-760cff08a92f service nova] [instance: 84b93526-cf57-4c07-ac77-9ae6ab68cf01] Received event network-vif-deleted-2f32e4c9-a025-4eca-978a-12792cdec0a5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.284s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk 1073741824" returned: 0 in 0.078s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:57 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Deleted allocations for instance 84b93526-cf57-4c07-ac77-9ae6ab68cf01
Nov 15 14:21:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Successfully created port: ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-254e4f7a-74a3-4b4e-973d-649f209d0b39 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "84b93526-cf57-4c07-ac77-9ae6ab68cf01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.462s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Cannot resize image /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Ensure instance console log exists: /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Successfully updated port: ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquired lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:21:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Releasing lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance network_info: |[{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Start _get_guest_xml network_info=[{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:21:59 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:59 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1081380142',display_name='tempest-ServerStableDeviceRescueTest-server-1081380142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1081380142',id=21,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOEreWdSOh9C27OYv86KjUTql4Rj3DRrNfHz2wGjnrubcIDTk0yVVpeP/AIl3K9epUmRd45ekF5xJFn1eG0oe7Xow4qhLkHUh7OeXBDj2B+4tbr9ZyTAif/+eLweDmR0Q==',key_name='tempest-keypair-1042147050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ace93cdac442c087c0ee565ce6d91f',ramdisk_id='',reservation_id='r-k69uypdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1573183010',owner_user_name='tempest-ServerStableDeviceRescueTest-1573183010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2d08093aaa041d19f085ff9b5f822db',uuid=9e258725-b58a-46c8-a2f0-099e246564a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Converting VIF {"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:dd:80,bridge_name='br-int',has_traffic_filtering=True,id=ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6,network=Network(0f9ef846-aa53-4f02-bdfd-7400a9942de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5b32a8-6a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.objects.instance [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:21:59 user nova-compute[74892]:   <uuid>9e258725-b58a-46c8-a2f0-099e246564a6</uuid>
Nov 15 14:21:59 user nova-compute[74892]:   <name>instance-00000015</name>
Nov 15 14:21:59 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:21:59 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:21:59 user nova-compute[74892]:   <metadata>
Nov 15 14:21:59 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:21:59 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:21:59 user nova-compute[74892]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1081380142</nova:name>
Nov 15 14:21:59 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:21:59</nova:creationTime>
Nov 15 14:21:59 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:21:59 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:21:59 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:21:59 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:21:59 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:21:59 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:21:59 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:21:59 user nova-compute[74892]:       <nova:owner>
Nov 15 14:21:59 user nova-compute[74892]:         <nova:user uuid="d2d08093aaa041d19f085ff9b5f822db">tempest-ServerStableDeviceRescueTest-1573183010-project-member</nova:user>
Nov 15 14:21:59 user nova-compute[74892]:         <nova:project uuid="d0ace93cdac442c087c0ee565ce6d91f">tempest-ServerStableDeviceRescueTest-1573183010</nova:project>
Nov 15 14:21:59 user nova-compute[74892]:       </nova:owner>
Nov 15 14:21:59 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:21:59 user nova-compute[74892]:       <nova:ports>
Nov 15 14:21:59 user nova-compute[74892]:         <nova:port uuid="ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6">
Nov 15 14:21:59 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 14:21:59 user nova-compute[74892]:         </nova:port>
Nov 15 14:21:59 user nova-compute[74892]:       </nova:ports>
Nov 15 14:21:59 user nova-compute[74892]:     </nova:instance>
Nov 15 14:21:59 user nova-compute[74892]:   </metadata>
Nov 15 14:21:59 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:21:59 user nova-compute[74892]:     <system>
Nov 15 14:21:59 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:21:59 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:21:59 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:21:59 user nova-compute[74892]:       <entry name="serial">9e258725-b58a-46c8-a2f0-099e246564a6</entry>
Nov 15 14:21:59 user nova-compute[74892]:       <entry name="uuid">9e258725-b58a-46c8-a2f0-099e246564a6</entry>
Nov 15 14:21:59 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:21:59 user nova-compute[74892]:     </system>
Nov 15 14:21:59 user nova-compute[74892]:   </sysinfo>
Nov 15 14:21:59 user nova-compute[74892]:   <os>
Nov 15 14:21:59 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:21:59 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:21:59 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:21:59 user nova-compute[74892]:   </os>
Nov 15 14:21:59 user nova-compute[74892]:   <features>
Nov 15 14:21:59 user nova-compute[74892]:     <acpi/>
Nov 15 14:21:59 user nova-compute[74892]:     <apic/>
Nov 15 14:21:59 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:21:59 user nova-compute[74892]:   </features>
Nov 15 14:21:59 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:21:59 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:21:59 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:21:59 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:21:59 user nova-compute[74892]:   </clock>
Nov 15 14:21:59 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:21:59 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:21:59 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:21:59 user nova-compute[74892]:   </cpu>
Nov 15 14:21:59 user nova-compute[74892]:   <devices>
Nov 15 14:21:59 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:21:59 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:21:59 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk"/>
Nov 15 14:21:59 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:21:59 user nova-compute[74892]:     </disk>
Nov 15 14:21:59 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:21:59 user nova-compute[74892]:       <mac address="fa:16:3e:13:dd:80"/>
Nov 15 14:21:59 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:59 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:21:59 user nova-compute[74892]:       <target dev="tapec5b32a8-6a"/>
Nov 15 14:21:59 user nova-compute[74892]:     </interface>
Nov 15 14:21:59 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:21:59 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/console.log" append="off"/>
Nov 15 14:21:59 user nova-compute[74892]:     </serial>
Nov 15 14:21:59 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:21:59 user nova-compute[74892]:     <video>
Nov 15 14:21:59 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:21:59 user nova-compute[74892]:     </video>
Nov 15 14:21:59 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:21:59 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:21:59 user nova-compute[74892]:     </rng>
Nov 15 14:21:59 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:21:59 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:21:59 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:21:59 user nova-compute[74892]:     </memballoon>
Nov 15 14:21:59 user nova-compute[74892]:   </devices>
Nov 15 14:21:59 user nova-compute[74892]: </domain>
Nov 15 14:21:59 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1081380142',display_name='tempest-ServerStableDeviceRescueTest-server-1081380142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1081380142',id=21,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOEreWdSOh9C27OYv86KjUTql4Rj3DRrNfHz2wGjnrubcIDTk0yVVpeP/AIl3K9epUmRd45ekF5xJFn1eG0oe7Xow4qhLkHUh7OeXBDj2B+4tbr9ZyTAif/+eLweDmR0Q==',key_name='tempest-keypair-1042147050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d0ace93cdac442c087c0ee565ce6d91f',ramdisk_id='',reservation_id='r-k69uypdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1573183010',owner_user_name='tempest-ServerStableDeviceRescueTest-1573183010-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2d08093aaa041d19f085ff9b5f822db',uuid=9e258725-b58a-46c8-a2f0-099e246564a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Converting VIF {"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:dd:80,bridge_name='br-int',has_traffic_filtering=True,id=ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6,network=Network(0f9ef846-aa53-4f02-bdfd-7400a9942de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5b32a8-6a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG os_vif [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:dd:80,bridge_name='br-int',has_traffic_filtering=True,id=ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6,network=Network(0f9ef846-aa53-4f02-bdfd-7400a9942de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5b32a8-6a') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '736e55c8-51aa-5847-a57a-bf8430d8fb64', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec5b32a8-6a, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec5b32a8-6a, col_values=(('qos', UUID('84a4d64f-a670-432e-a8ed-1ce92efca0f1')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec5b32a8-6a, col_values=(('external_ids', {'iface-id': 'ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:dd:80', 'vm-uuid': '9e258725-b58a-46c8-a2f0-099e246564a6'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:21:59 user nova-compute[74892]: INFO os_vif [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:dd:80,bridge_name='br-int',has_traffic_filtering=True,id=ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6,network=Network(0f9ef846-aa53-4f02-bdfd-7400a9942de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5b32a8-6a')
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No VIF found with MAC fa:16:3e:13:dd:80, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-2ac37aae-ebf2-4e39-a051-c973dc615061 req-ed1b6a20-a9fa-47ca-98ff-4ea310cef087 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-changed-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-2ac37aae-ebf2-4e39-a051-c973dc615061 req-ed1b6a20-a9fa-47ca-98ff-4ea310cef087 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Refreshing instance network info cache due to event network-changed-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2ac37aae-ebf2-4e39-a051-c973dc615061 req-ed1b6a20-a9fa-47ca-98ff-4ea310cef087 service nova] Acquiring lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2ac37aae-ebf2-4e39-a051-c973dc615061 req-ed1b6a20-a9fa-47ca-98ff-4ea310cef087 service nova] Acquired lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:21:59 user nova-compute[74892]: DEBUG nova.network.neutron [req-2ac37aae-ebf2-4e39-a051-c973dc615061 req-ed1b6a20-a9fa-47ca-98ff-4ea310cef087 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Refreshing network info cache for port ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:22:00 user nova-compute[74892]: DEBUG nova.network.neutron [req-2ac37aae-ebf2-4e39-a051-c973dc615061 req-ed1b6a20-a9fa-47ca-98ff-4ea310cef087 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updated VIF entry in instance network info cache for port ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:22:00 user nova-compute[74892]: DEBUG nova.network.neutron [req-2ac37aae-ebf2-4e39-a051-c973dc615061 req-ed1b6a20-a9fa-47ca-98ff-4ea310cef087 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2ac37aae-ebf2-4e39-a051-c973dc615061 req-ed1b6a20-a9fa-47ca-98ff-4ea310cef087 service nova] Releasing lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:22:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:01 user nova-compute[74892]: WARNING nova.compute.manager [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state building and task_state spawning.
Nov 15 14:22:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:01 user nova-compute[74892]: WARNING nova.compute.manager [req-ab7e8876-5617-4131-9f28-7669fc1e973a req-60bd4c72-22eb-4146-8e34-37ddafc9e05c service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state building and task_state spawning.
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:22:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance spawned successfully.
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:03 user nova-compute[74892]: INFO nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 15 14:22:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:22:03 user nova-compute[74892]: INFO nova.compute.manager [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Took 6.82 seconds to build instance.
Nov 15 14:22:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2bb3a66-c208-47ad-adc9-7f889a80b473 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.288s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:22:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:22 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:22:22 user nova-compute[74892]: INFO nova.compute.claims [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Claim successful on node user
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:22:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.policy [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe8ee8649f3b48659762693b148066ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a556e70db2546b99136e2e3c2e863fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:22:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Creating image(s)
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "/opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "/opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "/opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.166s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk 1073741824" returned: 0 in 0.050s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Successfully created port: ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:22:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Cannot resize image /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Ensure instance console log exists: /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Successfully updated port: ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-2294901d-6c57-4374-88da-7e411627fdfe req-7074f6f4-0665-463d-a523-01bae2fb2729 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Received event network-changed-ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-2294901d-6c57-4374-88da-7e411627fdfe req-7074f6f4-0665-463d-a523-01bae2fb2729 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Refreshing instance network info cache due to event network-changed-ab76f511-3249-4943-9781-1d8945049430. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2294901d-6c57-4374-88da-7e411627fdfe req-7074f6f4-0665-463d-a523-01bae2fb2729 service nova] Acquiring lock "refresh_cache-eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2294901d-6c57-4374-88da-7e411627fdfe req-7074f6f4-0665-463d-a523-01bae2fb2729 service nova] Acquired lock "refresh_cache-eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-2294901d-6c57-4374-88da-7e411627fdfe req-7074f6f4-0665-463d-a523-01bae2fb2729 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Refreshing network info cache for port ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-2294901d-6c57-4374-88da-7e411627fdfe req-7074f6f4-0665-463d-a523-01bae2fb2729 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "refresh_cache-eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-2294901d-6c57-4374-88da-7e411627fdfe req-7074f6f4-0665-463d-a523-01bae2fb2729 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2294901d-6c57-4374-88da-7e411627fdfe req-7074f6f4-0665-463d-a523-01bae2fb2729 service nova] Releasing lock "refresh_cache-eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquired lock "refresh_cache-eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Updating instance_info_cache with network_info: [{"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Releasing lock "refresh_cache-eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Instance network_info: |[{"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Start _get_guest_xml network_info=[{"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:22:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:22:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:22:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-52777240',display_name='tempest-VolumesActionsTest-instance-52777240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-52777240',id=22,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a556e70db2546b99136e2e3c2e863fa',ramdisk_id='',reservation_id='r-n759sm8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775831030',owner_user_name='tempest-VolumesActionsTest-1775831030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:22:23Z,user_data=None,user_id='fe8ee8649f3b48659762693b148066ec',uuid=eb9a1c70-0015-4c2a-ae2e-4ec79b06b094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Converting VIF {"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c4:95,bridge_name='br-int',has_traffic_filtering=True,id=ab76f511-3249-4943-9781-1d8945049430,network=Network(5f705d5d-4ec3-461b-a462-4632c3a2763f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab76f511-32') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.objects.instance [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lazy-loading 'pci_devices' on Instance uuid eb9a1c70-0015-4c2a-ae2e-4ec79b06b094 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:22:25 user nova-compute[74892]:   <uuid>eb9a1c70-0015-4c2a-ae2e-4ec79b06b094</uuid>
Nov 15 14:22:25 user nova-compute[74892]:   <name>instance-00000016</name>
Nov 15 14:22:25 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:22:25 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:22:25 user nova-compute[74892]:   <metadata>
Nov 15 14:22:25 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:22:25 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:22:25 user nova-compute[74892]:       <nova:name>tempest-VolumesActionsTest-instance-52777240</nova:name>
Nov 15 14:22:25 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:22:24</nova:creationTime>
Nov 15 14:22:25 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:22:25 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:22:25 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:22:25 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:22:25 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:22:25 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:22:25 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:22:25 user nova-compute[74892]:       <nova:owner>
Nov 15 14:22:25 user nova-compute[74892]:         <nova:user uuid="fe8ee8649f3b48659762693b148066ec">tempest-VolumesActionsTest-1775831030-project-member</nova:user>
Nov 15 14:22:25 user nova-compute[74892]:         <nova:project uuid="0a556e70db2546b99136e2e3c2e863fa">tempest-VolumesActionsTest-1775831030</nova:project>
Nov 15 14:22:25 user nova-compute[74892]:       </nova:owner>
Nov 15 14:22:25 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:22:25 user nova-compute[74892]:       <nova:ports>
Nov 15 14:22:25 user nova-compute[74892]:         <nova:port uuid="ab76f511-3249-4943-9781-1d8945049430">
Nov 15 14:22:25 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:22:25 user nova-compute[74892]:         </nova:port>
Nov 15 14:22:25 user nova-compute[74892]:       </nova:ports>
Nov 15 14:22:25 user nova-compute[74892]:     </nova:instance>
Nov 15 14:22:25 user nova-compute[74892]:   </metadata>
Nov 15 14:22:25 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:22:25 user nova-compute[74892]:     <system>
Nov 15 14:22:25 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:22:25 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:22:25 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:22:25 user nova-compute[74892]:       <entry name="serial">eb9a1c70-0015-4c2a-ae2e-4ec79b06b094</entry>
Nov 15 14:22:25 user nova-compute[74892]:       <entry name="uuid">eb9a1c70-0015-4c2a-ae2e-4ec79b06b094</entry>
Nov 15 14:22:25 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:22:25 user nova-compute[74892]:     </system>
Nov 15 14:22:25 user nova-compute[74892]:   </sysinfo>
Nov 15 14:22:25 user nova-compute[74892]:   <os>
Nov 15 14:22:25 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:22:25 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:22:25 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:22:25 user nova-compute[74892]:   </os>
Nov 15 14:22:25 user nova-compute[74892]:   <features>
Nov 15 14:22:25 user nova-compute[74892]:     <acpi/>
Nov 15 14:22:25 user nova-compute[74892]:     <apic/>
Nov 15 14:22:25 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:22:25 user nova-compute[74892]:   </features>
Nov 15 14:22:25 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:22:25 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:22:25 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:22:25 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:22:25 user nova-compute[74892]:   </clock>
Nov 15 14:22:25 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:22:25 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:22:25 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:22:25 user nova-compute[74892]:   </cpu>
Nov 15 14:22:25 user nova-compute[74892]:   <devices>
Nov 15 14:22:25 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:22:25 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:22:25 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk"/>
Nov 15 14:22:25 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:22:25 user nova-compute[74892]:     </disk>
Nov 15 14:22:25 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:22:25 user nova-compute[74892]:       <mac address="fa:16:3e:4d:c4:95"/>
Nov 15 14:22:25 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:22:25 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:22:25 user nova-compute[74892]:       <target dev="tapab76f511-32"/>
Nov 15 14:22:25 user nova-compute[74892]:     </interface>
Nov 15 14:22:25 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:22:25 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/console.log" append="off"/>
Nov 15 14:22:25 user nova-compute[74892]:     </serial>
Nov 15 14:22:25 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:22:25 user nova-compute[74892]:     <video>
Nov 15 14:22:25 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:22:25 user nova-compute[74892]:     </video>
Nov 15 14:22:25 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:22:25 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:22:25 user nova-compute[74892]:     </rng>
Nov 15 14:22:25 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:22:25 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:22:25 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:22:25 user nova-compute[74892]:     </memballoon>
Nov 15 14:22:25 user nova-compute[74892]:   </devices>
Nov 15 14:22:25 user nova-compute[74892]: </domain>
Nov 15 14:22:25 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-52777240',display_name='tempest-VolumesActionsTest-instance-52777240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-52777240',id=22,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a556e70db2546b99136e2e3c2e863fa',ramdisk_id='',reservation_id='r-n759sm8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775831030',owner_user_name='tempest-VolumesActionsTest-1775831030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:22:23Z,user_data=None,user_id='fe8ee8649f3b48659762693b148066ec',uuid=eb9a1c70-0015-4c2a-ae2e-4ec79b06b094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Converting VIF {"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c4:95,bridge_name='br-int',has_traffic_filtering=True,id=ab76f511-3249-4943-9781-1d8945049430,network=Network(5f705d5d-4ec3-461b-a462-4632c3a2763f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab76f511-32') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG os_vif [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c4:95,bridge_name='br-int',has_traffic_filtering=True,id=ab76f511-3249-4943-9781-1d8945049430,network=Network(5f705d5d-4ec3-461b-a462-4632c3a2763f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab76f511-32') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0f592521-8cff-5283-8e20-23276adfc1fe', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab76f511-32, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab76f511-32, col_values=(('qos', UUID('77ef182d-b480-46fe-94cd-e0455ed62475')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab76f511-32, col_values=(('external_ids', {'iface-id': 'ab76f511-3249-4943-9781-1d8945049430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:c4:95', 'vm-uuid': 'eb9a1c70-0015-4c2a-ae2e-4ec79b06b094'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:25 user nova-compute[74892]: INFO os_vif [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c4:95,bridge_name='br-int',has_traffic_filtering=True,id=ab76f511-3249-4943-9781-1d8945049430,network=Network(5f705d5d-4ec3-461b-a462-4632c3a2763f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab76f511-32')
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:22:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] No VIF found with MAC fa:16:3e:4d:c4:95, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-f9c69cf7-c693-4931-b13f-ad9ab5097a2e req-eab818c9-e5d4-47d2-9ddd-6b8f2df4ec55 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Received event network-vif-plugged-ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f9c69cf7-c693-4931-b13f-ad9ab5097a2e req-eab818c9-e5d4-47d2-9ddd-6b8f2df4ec55 service nova] Acquiring lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f9c69cf7-c693-4931-b13f-ad9ab5097a2e req-eab818c9-e5d4-47d2-9ddd-6b8f2df4ec55 service nova] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f9c69cf7-c693-4931-b13f-ad9ab5097a2e req-eab818c9-e5d4-47d2-9ddd-6b8f2df4ec55 service nova] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-f9c69cf7-c693-4931-b13f-ad9ab5097a2e req-eab818c9-e5d4-47d2-9ddd-6b8f2df4ec55 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] No waiting events found dispatching network-vif-plugged-ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:26 user nova-compute[74892]: WARNING nova.compute.manager [req-f9c69cf7-c693-4931-b13f-ad9ab5097a2e req-eab818c9-e5d4-47d2-9ddd-6b8f2df4ec55 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Received unexpected event network-vif-plugged-ab76f511-3249-4943-9781-1d8945049430 for instance with vm_state building and task_state spawning.
Nov 15 14:22:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:22:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Instance spawned successfully.
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:28 user nova-compute[74892]: INFO nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-251942c9-9e5c-4359-a1f4-09e5c1d6e59e req-9e64fa5a-4b87-4382-bd70-7ec9ff86f611 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Received event network-vif-plugged-ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-251942c9-9e5c-4359-a1f4-09e5c1d6e59e req-9e64fa5a-4b87-4382-bd70-7ec9ff86f611 service nova] Acquiring lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-251942c9-9e5c-4359-a1f4-09e5c1d6e59e req-9e64fa5a-4b87-4382-bd70-7ec9ff86f611 service nova] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-251942c9-9e5c-4359-a1f4-09e5c1d6e59e req-9e64fa5a-4b87-4382-bd70-7ec9ff86f611 service nova] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-251942c9-9e5c-4359-a1f4-09e5c1d6e59e req-9e64fa5a-4b87-4382-bd70-7ec9ff86f611 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] No waiting events found dispatching network-vif-plugged-ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:28 user nova-compute[74892]: WARNING nova.compute.manager [req-251942c9-9e5c-4359-a1f4-09e5c1d6e59e req-9e64fa5a-4b87-4382-bd70-7ec9ff86f611 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Received unexpected event network-vif-plugged-ab76f511-3249-4943-9781-1d8945049430 for instance with vm_state building and task_state spawning.
Nov 15 14:22:28 user nova-compute[74892]: INFO nova.compute.manager [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Took 6.18 seconds to build instance.
Nov 15 14:22:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9411541a-64ba-42ce-8406-09fc492a44ad tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.278s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-dfbe3cfa-340a-4464-9b69-e1b301a0fac4 req-a56426c0-d93b-4588-8f45-4c007bba5d01 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-changed-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-dfbe3cfa-340a-4464-9b69-e1b301a0fac4 req-a56426c0-d93b-4588-8f45-4c007bba5d01 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Refreshing instance network info cache due to event network-changed-875aae3f-fa95-4bf3-8790-42171f0f7fac. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dfbe3cfa-340a-4464-9b69-e1b301a0fac4 req-a56426c0-d93b-4588-8f45-4c007bba5d01 service nova] Acquiring lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dfbe3cfa-340a-4464-9b69-e1b301a0fac4 req-a56426c0-d93b-4588-8f45-4c007bba5d01 service nova] Acquired lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-dfbe3cfa-340a-4464-9b69-e1b301a0fac4 req-a56426c0-d93b-4588-8f45-4c007bba5d01 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Refreshing network info cache for port 875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-dfbe3cfa-340a-4464-9b69-e1b301a0fac4 req-a56426c0-d93b-4588-8f45-4c007bba5d01 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Updated VIF entry in instance network info cache for port 875aae3f-fa95-4bf3-8790-42171f0f7fac. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-dfbe3cfa-340a-4464-9b69-e1b301a0fac4 req-a56426c0-d93b-4588-8f45-4c007bba5d01 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Updating instance_info_cache with network_info: [{"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dfbe3cfa-340a-4464-9b69-e1b301a0fac4 req-a56426c0-d93b-4588-8f45-4c007bba5d01 service nova] Releasing lock "refresh_cache-726e0f64-5808-4e5b-accf-190ed1537b44" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG nova.objects.instance [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'flavor' on Instance uuid 726e0f64-5808-4e5b-accf-190ed1537b44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:32 user nova-compute[74892]: INFO nova.compute.manager [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Attaching volume 523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc to /dev/vdb
Nov 15 14:22:32 user nova-compute[74892]: DEBUG os_brick.utils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd656e62-e9fa-4c4e-a2c2-5ab13160f048]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8b1801-4896-4402-821c-c6c67527a8ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:32 user nova-compute[74892]: INFO nova.compute.manager [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Detaching volume d3f5accf-d711-46f6-bf5e-631621cb2b0f
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a14ab2e-49fb-47b1-b35e-70fd85a33e7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[15af7733-47ac-4d12-a6fb-80509a6a0756]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:22:32 user nova-compute[74892]: INFO nova.virt.block_device [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Attempting to driver detach volume d3f5accf-d711-46f6-bf5e-631621cb2b0f from mountpoint /dev/vdc
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:22:32 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:22:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f8f700-1a04-4943-a079-ac76c82195dd]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG os_brick.utils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Updating existing volume attachment record: 07063e5d-1d3c-4698-8a62-c955ffcfee60 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Attempting to detach device vdc from instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:22:32 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:22:32 user nova-compute[74892]:   <source dev="/dev/sde"/>
Nov 15 14:22:32 user nova-compute[74892]:   <target dev="vdc" bus="virtio"/>
Nov 15 14:22:32 user nova-compute[74892]:   <serial>d3f5accf-d711-46f6-bf5e-631621cb2b0f</serial>
Nov 15 14:22:32 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 14:22:32 user nova-compute[74892]: </disk>
Nov 15 14:22:32 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:22:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully detached device vdc from instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 from the persistent domain config.
Nov 15 14:22:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:22:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:22:32 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:22:32 user nova-compute[74892]:   <source dev="/dev/sde"/>
Nov 15 14:22:32 user nova-compute[74892]:   <target dev="vdc" bus="virtio"/>
Nov 15 14:22:32 user nova-compute[74892]:   <serial>d3f5accf-d711-46f6-bf5e-631621cb2b0f</serial>
Nov 15 14:22:32 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 14:22:32 user nova-compute[74892]: </disk>
Nov 15 14:22:32 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:22:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:22:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:36 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:36 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:22:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkgwAsKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:37 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:37 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:37 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[98966267-9fc9-44bc-8849-248a9534639a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:22:37 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e59039-72a6-4da1-9717-1e91630f3557]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc] added
Nov 15 14:22:37 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c50e178-b0c4-41df-9356-596f6d9b3069]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[40462814-5ff5-4808-8aad-95c4ff0924af]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkgwAsKb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkgwAsKb" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[31604231-109b-418f-aafd-6438920e1953]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkgwAsKb'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb8624-53f7-46f1-93e5-8c2fea7b2dbf]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d77528-fa58-46b9-b7f6-1e7adc257e7d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:37 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:37 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[de477243-f214-4021-a34b-c6f04ad45097]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260]
Nov 15 14:22:37 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260] successful.
Nov 15 14:22:37 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ff475-aa6f-4c6b-9fe9-c3b2dbb4cfa4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88a9fde-b47e-494d-b95a-9c05b768ec81]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:37 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:37 user nova-compute[74892]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:37 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b807ba1-6e60-4715-a9ea-8bd10589c2da]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkgwAsKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26637633064346636', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633064346636', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG nova.objects.instance [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'flavor' on Instance uuid 726e0f64-5808-4e5b-accf-190ed1537b44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:22:38 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:22:38 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:22:38 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:22:38 user nova-compute[74892]:   <serial>523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc</serial>
Nov 15 14:22:38 user nova-compute[74892]: </disk>
Nov 15 14:22:38 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No VIF found with MAC fa:16:3e:e3:f1:9d, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03df049d-e350-4894-bfa8-66c9b99a075d tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.935s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:40 user nova-compute[74892]: INFO nova.compute.manager [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Rebuilding instance
Nov 15 14:22:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-889eb6a8-204f-48b4-bb5b-1d6e6c8125df req-7edef0d8-cd36-429f-a442-5eab9df8e916 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-unplugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-889eb6a8-204f-48b4-bb5b-1d6e6c8125df req-7edef0d8-cd36-429f-a442-5eab9df8e916 service nova] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-889eb6a8-204f-48b4-bb5b-1d6e6c8125df req-7edef0d8-cd36-429f-a442-5eab9df8e916 service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-889eb6a8-204f-48b4-bb5b-1d6e6c8125df req-7edef0d8-cd36-429f-a442-5eab9df8e916 service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-889eb6a8-204f-48b4-bb5b-1d6e6c8125df req-7edef0d8-cd36-429f-a442-5eab9df8e916 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] No waiting events found dispatching network-vif-unplugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:41 user nova-compute[74892]: WARNING nova.compute.manager [req-889eb6a8-204f-48b4-bb5b-1d6e6c8125df req-7edef0d8-cd36-429f-a442-5eab9df8e916 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received unexpected event network-vif-unplugged-875aae3f-fa95-4bf3-8790-42171f0f7fac for instance with vm_state active and task_state rebuilding.
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:41 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance destroyed successfully.
Nov 15 14:22:41 user nova-compute[74892]: INFO nova.compute.manager [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Detaching volume 523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc
Nov 15 14:22:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: INFO nova.virt.block_device [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Attempting to driver detach volume 523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc from mountpoint /dev/vdb
Nov 15 14:22:42 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:22:42 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=6779MB free_disk=25.147167205810547GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Attempting to detach device vdb from instance 726e0f64-5808-4e5b-accf-190ed1537b44 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:22:42 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:22:42 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:22:42 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:22:42 user nova-compute[74892]:   <serial>523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc</serial>
Nov 15 14:22:42 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:22:42 user nova-compute[74892]: </disk>
Nov 15 14:22:42 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:22:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully detached device vdb from instance 726e0f64-5808-4e5b-accf-190ed1537b44 from the persistent domain config.
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkgwAsKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:42 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb06f522-d8e9-4117-8e6f-6085423cbabf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:22:42 user nova-compute[74892]: No targets found.
Nov 15 14:22:42 user nova-compute[74892]: iSNS:
Nov 15 14:22:42 user nova-compute[74892]: No targets found.
Nov 15 14:22:42 user nova-compute[74892]: STATIC:
Nov 15 14:22:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc
Nov 15 14:22:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f
Nov 15 14:22:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8
Nov 15 14:22:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:42 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:22:42 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:42 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:42 user nova-compute[74892]: FIRMWARE:
Nov 15 14:22:42 user nova-compute[74892]: No targets found.
Nov 15 14:22:42 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:22:42 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:22:42 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc84c85b-fba5-41c8-8f23-f6e9a48662a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b42b6-733d-4daa-a234-9af3dea479fb]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:42 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:42 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:42 user nova-compute[74892]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:42 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:42 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:42 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:42 user nova-compute[74892]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:42 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2057caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Applying migration context for instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 as it has an incoming, in-progress migration e4805810-9284-482a-b3c2-8dd87bbad9a9. Migration status is finished {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 14:22:42 user nova-compute[74892]: INFO nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating resource usage from migration e4805810-9284-482a-b3c2-8dd87bbad9a9
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce6da8b-1704-4635-a5fb-70ddf6953168]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a038db7d-023b-44ac-a74e-be018b0b6492 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 726e0f64-5808-4e5b-accf-190ed1537b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Migration e4805810-9284-482a-b3c2-8dd87bbad9a9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a75e0d21-e9e0-4da9-a328-bac6aea1755c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 7287af69-2562-4bc2-8a9f-e3cf3bb0814f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d013f581-2c2a-4935-98d5-53b0904118ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9e258725-b58a-46c8-a2f0-099e246564a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance eb9a1c70-0015-4c2a-ae2e-4ec79b06b094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[60df8807-bb64-4d67-a019-ba8826c4b7f0]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce29eb4-4478-4607-bda0-ffbbab9f3df2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0177b36-9c56-46b5-90a7-4dbe87a0a03d]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[60463c50-91e1-437f-bb4e-b71131c89a35]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[32acc3a0-49cc-4f06-ba26-8fa12e40b01f]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260]
Nov 15 14:22:42 user nova-compute[74892]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260] successful.
Nov 15 14:22:42 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99c72a2-385c-497e-8e65-442d37d49ec5]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== disconnect_volume: return (328ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:42 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-0d896ba9-40af-4aa4-9e53-bd72f1f8e095 req-e02cd414-4b29-4ccd-b5dc-ca281cd77e8b service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0d896ba9-40af-4aa4-9e53-bd72f1f8e095 req-e02cd414-4b29-4ccd-b5dc-ca281cd77e8b service nova] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0d896ba9-40af-4aa4-9e53-bd72f1f8e095 req-e02cd414-4b29-4ccd-b5dc-ca281cd77e8b service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0d896ba9-40af-4aa4-9e53-bd72f1f8e095 req-e02cd414-4b29-4ccd-b5dc-ca281cd77e8b service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-0d896ba9-40af-4aa4-9e53-bd72f1f8e095 req-e02cd414-4b29-4ccd-b5dc-ca281cd77e8b service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] No waiting events found dispatching network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:43 user nova-compute[74892]: WARNING nova.compute.manager [req-0d896ba9-40af-4aa4-9e53-bd72f1f8e095 req-e02cd414-4b29-4ccd-b5dc-ca281cd77e8b service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received unexpected event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac for instance with vm_state active and task_state rebuilding.
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Port 4426f0fd-a229-4b73-a68e-6b9456304d1c binding to destination host user is already ACTIVE {{(pid=74892) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:22:43 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance destroyed successfully.
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-564451515',display_name='tempest-ServerActionsTestOtherA-server-1272670793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-564451515',id=16,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslINOZ2Yol005NIBUtitD9XCJI8RmHPHYUS8gMfH34ivLR6lUVp5HyfScCUSAKd+rmzUMD/uj5+fomrFGbop1y6YKyOzsM5Zmm+KMHhghi9NTsel0jkmy7KtNQMxeqjQ==',key_name='tempest-keypair-37804521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-720g3l5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:22:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=726e0f64-5808-4e5b-accf-190ed1537b44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_vif [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap875aae3f-fa, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a465fd94-2941-42f2-bd7b-43dc17cdfd2f) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:43 user nova-compute[74892]: INFO os_vif [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa')
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkgwAsKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:43 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb72653-28e9-478a-9a09-1445ac5c97b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:22:43 user nova-compute[74892]: No targets found.
Nov 15 14:22:43 user nova-compute[74892]: iSNS:
Nov 15 14:22:43 user nova-compute[74892]: No targets found.
Nov 15 14:22:43 user nova-compute[74892]: STATIC:
Nov 15 14:22:43 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f
Nov 15 14:22:43 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:43 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:43 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8
Nov 15 14:22:43 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:43 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:43 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:22:43 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:43 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:43 user nova-compute[74892]: FIRMWARE:
Nov 15 14:22:43 user nova-compute[74892]: No targets found.
Nov 15 14:22:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:22:43 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:22:43 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e88e5d4-65fd-4189-9363-49a27b29b0fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4bb829-9dc1-4327-8167-38257be3117d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:43 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:43 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:43 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:43 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd205629e0>, {}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Disconnecting from: [] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== disconnect_volume: return (68ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:22:43 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Deleting instance files /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44_del
Nov 15 14:22:43 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Deletion of /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44_del complete
Nov 15 14:22:43 user nova-compute[74892]: INFO nova.virt.block_device [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Booting with volume 523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc at /dev/vdb
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db85f87-4126-4fe9-8765-7a03b2b1b61d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d49865a-7eb0-4bae-b04f-87e7dd212a97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Creating tmpfile /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/tmponba8xgr to verify with other compute node that the instance is on the same shared storage. {{(pid=74892) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e40aff4-f731-411d-a9e2-34dbdfddd876]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5291e904-13b7-4f0e-9933-7887a71ed2d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid a87f39af-29c7-40ee-86c9-ed04a07b9d2e {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:22:43 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:22:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9643057-9d43-4ee7-8ca6-e7486c34d8db]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Updating existing volume attachment record: 2b27d59c-83d6-4292-960a-c202bef2e34a {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:22:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-61724a72-bede-4d46-ae86-184b78eb2d41 req-c49c128f-3234-4748-ada8-2e00269b104b service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-61724a72-bede-4d46-ae86-184b78eb2d41 req-c49c128f-3234-4748-ada8-2e00269b104b service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-61724a72-bede-4d46-ae86-184b78eb2d41 req-c49c128f-3234-4748-ada8-2e00269b104b service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-61724a72-bede-4d46-ae86-184b78eb2d41 req-c49c128f-3234-4748-ada8-2e00269b104b service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-61724a72-bede-4d46-ae86-184b78eb2d41 req-c49c128f-3234-4748-ada8-2e00269b104b service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:44 user nova-compute[74892]: WARNING nova.compute.manager [req-61724a72-bede-4d46-ae86-184b78eb2d41 req-c49c128f-3234-4748-ada8-2e00269b104b service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state resized and task_state resize_reverting.
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updating instance_info_cache with network_info: [{"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:22:44 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance destroyed successfully.
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lazy-loading 'resources' on Instance uuid 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:21:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_vif [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4426f0fd-a2, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb2dba89-d1e1-4459-9d48-6b53df589092) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:44 user nova-compute[74892]: INFO os_vif [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2')
Nov 15 14:22:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[00def5ed-38c9-46c4-80e5-46c911bcd151]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:22:44 user nova-compute[74892]: No targets found.
Nov 15 14:22:44 user nova-compute[74892]: iSNS:
Nov 15 14:22:44 user nova-compute[74892]: No targets found.
Nov 15 14:22:44 user nova-compute[74892]: STATIC:
Nov 15 14:22:44 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f
Nov 15 14:22:44 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:44 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:44 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8
Nov 15 14:22:44 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:44 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:44 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64
Nov 15 14:22:44 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:44 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:44 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:22:44 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:44 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:44 user nova-compute[74892]: FIRMWARE:
Nov 15 14:22:44 user nova-compute[74892]: No targets found.
Nov 15 14:22:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:22:44 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:22:44 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff293e1-e1b4-4ed5-9207-120c02ce7ea1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[24940e5c-fbd9-408b-8745-9ccb9a5d3645]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:44 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:44 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:44 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:44 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:44 user nova-compute[74892]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:44 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20702830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e053be-36ff-4341-b8d3-188bf711f237]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b97f2f3-c48d-4248-af32-26fc7a054cf3]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b66b58-c67f-420b-b67f-0091b3ed99e2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb33de2-f8c9-477f-95ca-f76f4a8f5ebe]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7d1eb6-0143-460f-90b1-dd7e58e37738]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b9fd4-4bd4-4f1d-9537-51fdb7969d7c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]
Nov 15 14:22:44 user nova-compute[74892]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:22:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0e99e7-718d-495e-b01e-074c69c513be]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== disconnect_volume: return (307ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lazy-loading 'migration_context' on Instance uuid 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:45 user nova-compute[74892]: DEBUG nova.objects.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Object Instance<2cd7a807-53cb-44d6-91cd-3a58b36f2963> lazy-loaded attributes: resources,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-f7cf44b5-15d7-4e82-9119-dc49459fa376 req-18a7a95e-4a03-4d78-987b-5ecf2f2f82c7 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f7cf44b5-15d7-4e82-9119-dc49459fa376 req-18a7a95e-4a03-4d78-987b-5ecf2f2f82c7 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f7cf44b5-15d7-4e82-9119-dc49459fa376 req-18a7a95e-4a03-4d78-987b-5ecf2f2f82c7 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f7cf44b5-15d7-4e82-9119-dc49459fa376 req-18a7a95e-4a03-4d78-987b-5ecf2f2f82c7 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-f7cf44b5-15d7-4e82-9119-dc49459fa376 req-18a7a95e-4a03-4d78-987b-5ecf2f2f82c7 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:46 user nova-compute[74892]: WARNING nova.compute.manager [req-f7cf44b5-15d7-4e82-9119-dc49459fa376 req-18a7a95e-4a03-4d78-987b-5ecf2f2f82c7 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state resized and task_state resize_reverting.
Nov 15 14:22:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.840s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:46 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:46 user nova-compute[74892]: INFO nova.compute.manager [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Swapping old allocation on dict_keys(['f0684847-d6be-43f9-9eb9-f058843467dc']) held by migration e4805810-9284-482a-b3c2-8dd87bbad9a9 for instance
Nov 15 14:22:46 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Overwriting current allocation {'allocations': {'f0684847-d6be-43f9-9eb9-f058843467dc': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 27}}, 'project_id': '7fe4fd8971a248c0a7058a1ff448ac92', 'user_id': '971828fdd5de481faf9ff0403ecdd3b0', 'consumer_generation': 1} on consumer 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 14:22:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:22:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:22:47 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:22:47 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:22:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:22:47 user nova-compute[74892]: DEBUG nova.network.neutron [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG os_brick.utils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c40d078-3932-4bf7-be78-b999613db864]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a091bf-a95b-4f86-8912-2939c2bcee13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1676050a-50a7-4355-81c8-6824c569552f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c790a2-6275-4a20-b514-8c0ee005ba69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:22:48 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d18ee7c-a52a-4406-a850-15ddbebfac27]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG os_brick.utils [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:48 user nova-compute[74892]: INFO nova.compute.manager [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Terminating instance
Nov 15 14:22:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-0ea6186f-fa8a-4a8e-89c9-80d0fdafa787 req-9dbf427d-961c-45b7-8489-e8ecc834d0c2 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received event network-vif-unplugged-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0ea6186f-fa8a-4a8e-89c9-80d0fdafa787 req-9dbf427d-961c-45b7-8489-e8ecc834d0c2 service nova] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0ea6186f-fa8a-4a8e-89c9-80d0fdafa787 req-9dbf427d-961c-45b7-8489-e8ecc834d0c2 service nova] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0ea6186f-fa8a-4a8e-89c9-80d0fdafa787 req-9dbf427d-961c-45b7-8489-e8ecc834d0c2 service nova] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-0ea6186f-fa8a-4a8e-89c9-80d0fdafa787 req-9dbf427d-961c-45b7-8489-e8ecc834d0c2 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] No waiting events found dispatching network-vif-unplugged-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-0ea6186f-fa8a-4a8e-89c9-80d0fdafa787 req-9dbf427d-961c-45b7-8489-e8ecc834d0c2 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received event network-vif-unplugged-188d856a-8fff-4e87-ada8-31361f90d65f for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:22:49 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Creating image(s)
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:49 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Instance destroyed successfully.
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.objects.instance [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lazy-loading 'resources' on Instance uuid a038db7d-023b-44ac-a74e-be018b0b6492 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:17:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1830236721',display_name='tempest-VolumesAdminNegativeTest-server-1830236721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1830236721',id=5,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmWmUu0SdyDj6U6V/VNcADVuloXAU7YNTuzTyukZMm6ffdwMmLz/GHqeTtndIMOOMU8/5wJBU+FuUyBUeSBtQyDSrc274iMvGOp95aA4/X60SJOwBEPvIBGSHfXfsTTWw==',key_name='tempest-keypair-881156275',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2ed8813ce754c82b8abaa69a5e509f1',ramdisk_id='',reservation_id='r-1x8vwaly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1173866799',owner_user_name='tempest-VolumesAdminNegativeTest-1173866799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5945249c9efe4a40980557b4aba1d0da',uuid=a038db7d-023b-44ac-a74e-be018b0b6492,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converting VIF {"id": "188d856a-8fff-4e87-ada8-31361f90d65f", "address": "fa:16:3e:e8:6d:79", "network": {"id": "84599ca4-6a0a-4d0d-85ca-94f34071c367", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1406800547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2ed8813ce754c82b8abaa69a5e509f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap188d856a-8f", "ovs_interfaceid": "188d856a-8fff-4e87-ada8-31361f90d65f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=188d856a-8fff-4e87-ada8-31361f90d65f,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d856a-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG os_vif [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=188d856a-8fff-4e87-ada8-31361f90d65f,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d856a-8f') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap188d856a-8f, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=956058a9-e2a8-4a1e-874f-51a58e72dafc) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:49 user nova-compute[74892]: INFO os_vif [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:6d:79,bridge_name='br-int',has_traffic_filtering=True,id=188d856a-8fff-4e87-ada8-31361f90d65f,network=Network(84599ca4-6a0a-4d0d-85ca-94f34071c367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap188d856a-8f')
Nov 15 14:22:49 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Deleting instance files /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492_del
Nov 15 14:22:49 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Deletion of /opt/stack/data/nova/instances/a038db7d-023b-44ac-a74e-be018b0b6492_del complete
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:49 user nova-compute[74892]: INFO nova.compute.manager [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk 1073741824" returned: 0 in 0.065s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.220s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:22:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Cannot resize image /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Ensure instance console log exists: /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Start _get_guest_xml network_info=[{"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkgwAsKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '726e0f64-5808-4e5b-accf-190ed1537b44', 'attached_at': '', 'detached_at': '', 'volume_id': '523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'serial': '523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '2b27d59c-83d6-4292-960a-c202bef2e34a', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:22:50 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 14:22:50 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'vcpu_model' on Instance uuid 726e0f64-5808-4e5b-accf-190ed1537b44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkgwAsKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:50 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:50 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:50 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[788e154b-d524-431f-9394-d51484950d89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:22:50 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11dbcf2-3932-4b20-a6d9-b536da8f4335]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc] added
Nov 15 14:22:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[62857528-5bc4-4f4f-969a-2fdf6ea7e216]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8386245-1a76-4cae-9849-3c0effdec5d7]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkgwAsKb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkgwAsKb" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a1c923-077f-40fe-8809-69bcf8d3f7ad]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkgwAsKb'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5a5d40-11fe-4cd5-9b66-89d25d715c12]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d076629-0fc0-4071-84a5-5d70e38acb71]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa80098-2b22-4426-8bf8-3b2cabd028e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260]
Nov 15 14:22:50 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260] successful.
Nov 15 14:22:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[51814b47-61a7-4cfd-bd8a-831bd3334de0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b26a021-597a-4046-a962-25eec213bde6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:50 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8d2bfa-f77f-4097-acc8-48b7aa1ef91a]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkgwAsKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:22:50 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:50 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Took 0.98 seconds to deallocate network for instance.
Nov 15 14:22:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-321a9d33-ef73-4daf-a47e-25d3b3af7479 req-3d562dc3-55e5-46b9-941d-e654ea90ec44 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received event network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-321a9d33-ef73-4daf-a47e-25d3b3af7479 req-3d562dc3-55e5-46b9-941d-e654ea90ec44 service nova] Acquiring lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-321a9d33-ef73-4daf-a47e-25d3b3af7479 req-3d562dc3-55e5-46b9-941d-e654ea90ec44 service nova] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-321a9d33-ef73-4daf-a47e-25d3b3af7479 req-3d562dc3-55e5-46b9-941d-e654ea90ec44 service nova] Lock "a038db7d-023b-44ac-a74e-be018b0b6492-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-321a9d33-ef73-4daf-a47e-25d3b3af7479 req-3d562dc3-55e5-46b9-941d-e654ea90ec44 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] No waiting events found dispatching network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:51 user nova-compute[74892]: WARNING nova.compute.manager [req-321a9d33-ef73-4daf-a47e-25d3b3af7479 req-3d562dc3-55e5-46b9-941d-e654ea90ec44 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received unexpected event network-vif-plugged-188d856a-8fff-4e87-ada8-31361f90d65f for instance with vm_state deleted and task_state None.
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-321a9d33-ef73-4daf-a47e-25d3b3af7479 req-3d562dc3-55e5-46b9-941d-e654ea90ec44 service nova] [instance: a038db7d-023b-44ac-a74e-be018b0b6492] Received event network-vif-deleted-188d856a-8fff-4e87-ada8-31361f90d65f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26637633064346636', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633064346636', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:22:51 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Deleted allocations for instance a038db7d-023b-44ac-a74e-be018b0b6492
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-564451515',display_name='tempest-ServerActionsTestOtherA-server-1272670793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-564451515',id=16,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslINOZ2Yol005NIBUtitD9XCJI8RmHPHYUS8gMfH34ivLR6lUVp5HyfScCUSAKd+rmzUMD/uj5+fomrFGbop1y6YKyOzsM5Zmm+KMHhghi9NTsel0jkmy7KtNQMxeqjQ==',key_name='tempest-keypair-37804521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-720g3l5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:22:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=726e0f64-5808-4e5b-accf-190ed1537b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:22:51 user nova-compute[74892]:   <uuid>726e0f64-5808-4e5b-accf-190ed1537b44</uuid>
Nov 15 14:22:51 user nova-compute[74892]:   <name>instance-00000010</name>
Nov 15 14:22:51 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:22:51 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:22:51 user nova-compute[74892]:   <metadata>
Nov 15 14:22:51 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:22:51 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:22:51 user nova-compute[74892]:       <nova:name>tempest-ServerActionsTestOtherA-server-1272670793</nova:name>
Nov 15 14:22:51 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:22:50</nova:creationTime>
Nov 15 14:22:51 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:22:51 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:22:51 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:22:51 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:22:51 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:22:51 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:22:51 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:22:51 user nova-compute[74892]:       <nova:owner>
Nov 15 14:22:51 user nova-compute[74892]:         <nova:user uuid="abe166e9b6134abf85db0e21ec1e100d">tempest-ServerActionsTestOtherA-2044893964-project-member</nova:user>
Nov 15 14:22:51 user nova-compute[74892]:         <nova:project uuid="bbe544848b48449381967e24f274b7bd">tempest-ServerActionsTestOtherA-2044893964</nova:project>
Nov 15 14:22:51 user nova-compute[74892]:       </nova:owner>
Nov 15 14:22:51 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:22:51 user nova-compute[74892]:       <nova:ports>
Nov 15 14:22:51 user nova-compute[74892]:         <nova:port uuid="875aae3f-fa95-4bf3-8790-42171f0f7fac">
Nov 15 14:22:51 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 14:22:51 user nova-compute[74892]:         </nova:port>
Nov 15 14:22:51 user nova-compute[74892]:       </nova:ports>
Nov 15 14:22:51 user nova-compute[74892]:     </nova:instance>
Nov 15 14:22:51 user nova-compute[74892]:   </metadata>
Nov 15 14:22:51 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:22:51 user nova-compute[74892]:     <system>
Nov 15 14:22:51 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:22:51 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:22:51 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:22:51 user nova-compute[74892]:       <entry name="serial">726e0f64-5808-4e5b-accf-190ed1537b44</entry>
Nov 15 14:22:51 user nova-compute[74892]:       <entry name="uuid">726e0f64-5808-4e5b-accf-190ed1537b44</entry>
Nov 15 14:22:51 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:22:51 user nova-compute[74892]:     </system>
Nov 15 14:22:51 user nova-compute[74892]:   </sysinfo>
Nov 15 14:22:51 user nova-compute[74892]:   <os>
Nov 15 14:22:51 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:22:51 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:22:51 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:22:51 user nova-compute[74892]:   </os>
Nov 15 14:22:51 user nova-compute[74892]:   <features>
Nov 15 14:22:51 user nova-compute[74892]:     <acpi/>
Nov 15 14:22:51 user nova-compute[74892]:     <apic/>
Nov 15 14:22:51 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:22:51 user nova-compute[74892]:   </features>
Nov 15 14:22:51 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:22:51 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:22:51 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:22:51 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:22:51 user nova-compute[74892]:   </clock>
Nov 15 14:22:51 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:22:51 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:22:51 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:22:51 user nova-compute[74892]:   </cpu>
Nov 15 14:22:51 user nova-compute[74892]:   <devices>
Nov 15 14:22:51 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:22:51 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:22:51 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk"/>
Nov 15 14:22:51 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:22:51 user nova-compute[74892]:     </disk>
Nov 15 14:22:51 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:22:51 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:22:51 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:22:51 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:22:51 user nova-compute[74892]:       <serial>523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc</serial>
Nov 15 14:22:51 user nova-compute[74892]:     </disk>
Nov 15 14:22:51 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:22:51 user nova-compute[74892]:       <mac address="fa:16:3e:e3:f1:9d"/>
Nov 15 14:22:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:22:51 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:22:51 user nova-compute[74892]:       <target dev="tap875aae3f-fa"/>
Nov 15 14:22:51 user nova-compute[74892]:     </interface>
Nov 15 14:22:51 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:22:51 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/console.log" append="off"/>
Nov 15 14:22:51 user nova-compute[74892]:     </serial>
Nov 15 14:22:51 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:22:51 user nova-compute[74892]:     <video>
Nov 15 14:22:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:22:51 user nova-compute[74892]:     </video>
Nov 15 14:22:51 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:22:51 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:22:51 user nova-compute[74892]:     </rng>
Nov 15 14:22:51 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:22:51 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:22:51 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:22:51 user nova-compute[74892]:     </memballoon>
Nov 15 14:22:51 user nova-compute[74892]:   </devices>
Nov 15 14:22:51 user nova-compute[74892]: </domain>
Nov 15 14:22:51 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-564451515',display_name='tempest-ServerActionsTestOtherA-server-1272670793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-564451515',id=16,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslINOZ2Yol005NIBUtitD9XCJI8RmHPHYUS8gMfH34ivLR6lUVp5HyfScCUSAKd+rmzUMD/uj5+fomrFGbop1y6YKyOzsM5Zmm+KMHhghi9NTsel0jkmy7KtNQMxeqjQ==',key_name='tempest-keypair-37804521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:20:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-720g3l5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:22:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=726e0f64-5808-4e5b-accf-190ed1537b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG os_vif [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4193e089-efec-5b09-9c96-a1248a86e9c6', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap875aae3f-fa, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap875aae3f-fa, col_values=(('qos', UUID('4e177433-62cf-4860-9e5f-0196ad9ab37d')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap875aae3f-fa, col_values=(('external_ids', {'iface-id': '875aae3f-fa95-4bf3-8790-42171f0f7fac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:f1:9d', 'vm-uuid': '726e0f64-5808-4e5b-accf-190ed1537b44'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:51 user nova-compute[74892]: INFO os_vif [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa')
Nov 15 14:22:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-56a3e57d-ca41-4b2a-906c-7b92bcec5b46 tempest-VolumesAdminNegativeTest-1173866799 tempest-VolumesAdminNegativeTest-1173866799-project-member] Lock "a038db7d-023b-44ac-a74e-be018b0b6492" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.018s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:22:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No VIF found with MAC fa:16:3e:e3:f1:9d, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:22:53 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 is timed out.
Nov 15 14:22:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully detached device vdc from instance ffa60aac-02a4-42ab-b97b-b9cc56079e44 from the live domain config.
Nov 15 14:22:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRqscaif', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:53 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd824e4-7b31-4fbf-b001-cd33bad6cde7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:22:53 user nova-compute[74892]: No targets found.
Nov 15 14:22:53 user nova-compute[74892]: iSNS:
Nov 15 14:22:53 user nova-compute[74892]: No targets found.
Nov 15 14:22:53 user nova-compute[74892]: STATIC:
Nov 15 14:22:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc
Nov 15 14:22:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f
Nov 15 14:22:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64
Nov 15 14:22:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:22:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:22:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:22:53 user nova-compute[74892]: FIRMWARE:
Nov 15 14:22:53 user nova-compute[74892]: No targets found.
Nov 15 14:22:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:22:53 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:22:53 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.099s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ca87ef-3ffc-4486-90f9-97c9897917df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[997765cf-dff1-4a2b-a6ca-95a1bac473b7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:53 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:53 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:53 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:53 user nova-compute[74892]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f (non-flash)
Nov 15 14:22:53 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:53 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd4c793eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f'): ({'sde'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Removing single pathed devices sde {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.107s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c25b37a-f310-474c-bda6-499936e40182]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa9ed2-6de8-4eef-9ac9-5118680e1b2f]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flushing IO for device /dev/sde {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.097s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82631bc-5246-4812-965c-4a0e8c0c5a12]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:22:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.159s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3884a9-9d42-4ddb-b153-45dae8aa57a5]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.067s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[453f4544-0fa7-432c-983e-6a3ac257a3c4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.204s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a3bb39-9ddc-4ee1-a619-faf73bf0265d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f, portal: 172.16.0.220,3260]
Nov 15 14:22:54 user nova-compute[74892]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f, portal: 172.16.0.220,3260] successful.
Nov 15 14:22:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d3f5accf-d711-46f6-bf5e-631621cb2b0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea7546c-fbf5-4bb9-9ea6-5c49fa15e549]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.974s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] <== disconnect_volume: return (976ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Starting finish_revert_migration {{(pid=74892) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Start _get_guest_xml network_info=[{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2cd7a807-53cb-44d6-91cd-3a58b36f2963', 'attached_at': '2023-11-15T14:22:54.000000', 'detached_at': '', 'volume_id': 'dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'serial': 'dc2faf3f-3393-465a-89b4-f7601e07c2e8'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '8a3156db-0a27-470e-a2be-aead654c303b', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:22:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:22:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:22:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:22:55 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[529037e4-48d5-49a9-b8ee-5a64f4981b0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:22:55 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-4fbdc3b4-cc67-4cd0-b91b-887ac71508bc req-710001e3-a06d-491f-825e-f494459448dc service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fbdc3b4-cc67-4cd0-b91b-887ac71508bc req-710001e3-a06d-491f-825e-f494459448dc service nova] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fbdc3b4-cc67-4cd0-b91b-887ac71508bc req-710001e3-a06d-491f-825e-f494459448dc service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4fbdc3b4-cc67-4cd0-b91b-887ac71508bc req-710001e3-a06d-491f-825e-f494459448dc service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-4fbdc3b4-cc67-4cd0-b91b-887ac71508bc req-710001e3-a06d-491f-825e-f494459448dc service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] No waiting events found dispatching network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:55 user nova-compute[74892]: WARNING nova.compute.manager [req-4fbdc3b4-cc67-4cd0-b91b-887ac71508bc req-710001e3-a06d-491f-825e-f494459448dc service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received unexpected event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac for instance with vm_state active and task_state rebuild_spawning.
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.116s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa972b36-40f4-4815-be25-99533b2d1a6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8] added
Nov 15 14:22:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.167s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[479d975a-d989-4d80-970a-0840d034a74c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'flavor' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.071s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec4015-387a-446e-8575-2edf40295aed]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yihUezAH {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yihUezAH" returned: 0 in 0.042s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa0fe3-4488-4492-890d-d521fb052721]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yihUezAH'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5bfa691d-0b45-4b02-bec1-6b75a96b0d1c tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.457s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc155d9-1054-4cc3-ba2b-291e9825bd27]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d081a8-8734-4c16-9504-cf230fd6519e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:55 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:55 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:55 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:55 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3f5529-e6ac-4239-8eeb-b1231ef1d575]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]
Nov 15 14:22:55 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:22:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c678a5-96e5-4369-b807-1eee11580a73]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c90061-8fca-42b8-96dd-a46aaafa36a8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:56 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:56 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:56 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:22:56 user nova-compute[74892]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:63874028-b906-46e4-a97b-c24e8d67ef64 (non-flash)
Nov 15 14:22:56 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:22:56 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:22:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.737s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ad86ec-72dd-48a6-885e-429edefdbdb8]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.774s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== connect_volume: return (1775ms) {'type': 'block', 'scsi_wwn': '26461373031623838', 'path': '/dev/sde'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461373031623838', 'path': '/dev/sde'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:22:57 user nova-compute[74892]:   <uuid>2cd7a807-53cb-44d6-91cd-3a58b36f2963</uuid>
Nov 15 14:22:57 user nova-compute[74892]:   <name>instance-00000002</name>
Nov 15 14:22:57 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:22:57 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:22:57 user nova-compute[74892]:   <metadata>
Nov 15 14:22:57 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:22:57 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:22:57 user nova-compute[74892]:       <nova:name>tempest-ServerActionsTestOtherB-server-151320545</nova:name>
Nov 15 14:22:57 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:22:55</nova:creationTime>
Nov 15 14:22:57 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:22:57 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:22:57 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:22:57 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:22:57 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:22:57 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:22:57 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:22:57 user nova-compute[74892]:       <nova:owner>
Nov 15 14:22:57 user nova-compute[74892]:         <nova:user uuid="971828fdd5de481faf9ff0403ecdd3b0">tempest-ServerActionsTestOtherB-1188247760-project-member</nova:user>
Nov 15 14:22:57 user nova-compute[74892]:         <nova:project uuid="7fe4fd8971a248c0a7058a1ff448ac92">tempest-ServerActionsTestOtherB-1188247760</nova:project>
Nov 15 14:22:57 user nova-compute[74892]:       </nova:owner>
Nov 15 14:22:57 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:22:57 user nova-compute[74892]:       <nova:ports>
Nov 15 14:22:57 user nova-compute[74892]:         <nova:port uuid="4426f0fd-a229-4b73-a68e-6b9456304d1c">
Nov 15 14:22:57 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:22:57 user nova-compute[74892]:         </nova:port>
Nov 15 14:22:57 user nova-compute[74892]:       </nova:ports>
Nov 15 14:22:57 user nova-compute[74892]:     </nova:instance>
Nov 15 14:22:57 user nova-compute[74892]:   </metadata>
Nov 15 14:22:57 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:22:57 user nova-compute[74892]:     <system>
Nov 15 14:22:57 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:22:57 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:22:57 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:22:57 user nova-compute[74892]:       <entry name="serial">2cd7a807-53cb-44d6-91cd-3a58b36f2963</entry>
Nov 15 14:22:57 user nova-compute[74892]:       <entry name="uuid">2cd7a807-53cb-44d6-91cd-3a58b36f2963</entry>
Nov 15 14:22:57 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:22:57 user nova-compute[74892]:     </system>
Nov 15 14:22:57 user nova-compute[74892]:   </sysinfo>
Nov 15 14:22:57 user nova-compute[74892]:   <os>
Nov 15 14:22:57 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:22:57 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:22:57 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:22:57 user nova-compute[74892]:   </os>
Nov 15 14:22:57 user nova-compute[74892]:   <features>
Nov 15 14:22:57 user nova-compute[74892]:     <acpi/>
Nov 15 14:22:57 user nova-compute[74892]:     <apic/>
Nov 15 14:22:57 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:22:57 user nova-compute[74892]:   </features>
Nov 15 14:22:57 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:22:57 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:22:57 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:22:57 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:22:57 user nova-compute[74892]:   </clock>
Nov 15 14:22:57 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:22:57 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:22:57 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:22:57 user nova-compute[74892]:   </cpu>
Nov 15 14:22:57 user nova-compute[74892]:   <devices>
Nov 15 14:22:57 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:22:57 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:22:57 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk"/>
Nov 15 14:22:57 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:22:57 user nova-compute[74892]:     </disk>
Nov 15 14:22:57 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:22:57 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:22:57 user nova-compute[74892]:       <source dev="/dev/sde"/>
Nov 15 14:22:57 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:22:57 user nova-compute[74892]:       <serial>dc2faf3f-3393-465a-89b4-f7601e07c2e8</serial>
Nov 15 14:22:57 user nova-compute[74892]:     </disk>
Nov 15 14:22:57 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:22:57 user nova-compute[74892]:       <mac address="fa:16:3e:3d:a8:cd"/>
Nov 15 14:22:57 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:22:57 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:22:57 user nova-compute[74892]:       <target dev="tap4426f0fd-a2"/>
Nov 15 14:22:57 user nova-compute[74892]:     </interface>
Nov 15 14:22:57 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:22:57 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/console.log" append="off"/>
Nov 15 14:22:57 user nova-compute[74892]:     </serial>
Nov 15 14:22:57 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:22:57 user nova-compute[74892]:     <video>
Nov 15 14:22:57 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:22:57 user nova-compute[74892]:     </video>
Nov 15 14:22:57 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:22:57 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:22:57 user nova-compute[74892]:     </rng>
Nov 15 14:22:57 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:22:57 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:22:57 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:22:57 user nova-compute[74892]:     </memballoon>
Nov 15 14:22:57 user nova-compute[74892]:   </devices>
Nov 15 14:22:57 user nova-compute[74892]: </domain>
Nov 15 14:22:57 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG os_vif [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c41c25ff-c945-50b8-8734-dd44f47af686', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4426f0fd-a2, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4426f0fd-a2, col_values=(('qos', UUID('698a9724-19d1-482b-81b1-bdff92752b5d')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4426f0fd-a2, col_values=(('external_ids', {'iface-id': '4426f0fd-a229-4b73-a68e-6b9456304d1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:a8:cd', 'vm-uuid': '2cd7a807-53cb-44d6-91cd-3a58b36f2963'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:57 user nova-compute[74892]: INFO os_vif [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2')
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] No waiting events found dispatching network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:57 user nova-compute[74892]: WARNING nova.compute.manager [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received unexpected event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac for instance with vm_state active and task_state rebuild_spawning.
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-changed-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Refreshing instance network info cache due to event network-changed-904d19af-084f-43ac-8378-cf5b7e822961. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] Acquiring lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] Acquired lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Refreshing network info cache for port 904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:22:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:22:58 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance spawned successfully.
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.network.neutron [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updated VIF entry in instance network info cache for port 904d19af-084f-43ac-8378-cf5b7e822961. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.network.neutron [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating instance_info_cache with network_info: [{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a9410a17-d9d2-460f-a09e-c24d0cbc484c req-f27403f4-97c7-4dbe-b346-c7f84a1ad145 service nova] Releasing lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74892) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3711e490-2743-4443-965f-6cc44eaa2482 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.198s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-b5f32c20-05b1-4b3d-a71f-025b0b419738 req-69a86ba8-db73-4c2d-acfc-e58615063f68 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b5f32c20-05b1-4b3d-a71f-025b0b419738 req-69a86ba8-db73-4c2d-acfc-e58615063f68 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b5f32c20-05b1-4b3d-a71f-025b0b419738 req-69a86ba8-db73-4c2d-acfc-e58615063f68 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b5f32c20-05b1-4b3d-a71f-025b0b419738 req-69a86ba8-db73-4c2d-acfc-e58615063f68 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-b5f32c20-05b1-4b3d-a71f-025b0b419738 req-69a86ba8-db73-4c2d-acfc-e58615063f68 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:22:59 user nova-compute[74892]: WARNING nova.compute.manager [req-b5f32c20-05b1-4b3d-a71f-025b0b419738 req-69a86ba8-db73-4c2d-acfc-e58615063f68 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state resized and task_state resize_reverting.
Nov 15 14:22:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:22:59 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:00 user nova-compute[74892]: INFO nova.compute.manager [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Attaching volume 817f9b79-ad7a-40e2-bcde-9be2b56ae109 to /dev/vdb
Nov 15 14:23:00 user nova-compute[74892]: DEBUG os_brick.utils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[629f7e11-9690-4008-a3b0-5918c84573dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[823650bd-0607-402d-9be9-a6716d0f6f28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.050s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f8675d-bd3d-4fb3-826d-b4e0daddf13d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde9c465-012c-4d17-b492-c43a8156faf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:23:00 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:23:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[639e923b-af45-4703-a9f6-b64c41a544e9]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG os_brick.utils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:23:00 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating existing volume attachment record: 337aef95-f99f-44c0-a7f0-58f05257b81f {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:23:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:23:01 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance running successfully.
Nov 15 14:23:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] finish_revert_migration finished successfully. {{(pid=74892) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 14:23:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-c7709090-f7ea-45ac-8b46-336bdd903925 req-ead244a0-5a1b-4fd4-8115-09432e4f7cb8 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c7709090-f7ea-45ac-8b46-336bdd903925 req-ead244a0-5a1b-4fd4-8115-09432e4f7cb8 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c7709090-f7ea-45ac-8b46-336bdd903925 req-ead244a0-5a1b-4fd4-8115-09432e4f7cb8 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c7709090-f7ea-45ac-8b46-336bdd903925 req-ead244a0-5a1b-4fd4-8115-09432e4f7cb8 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-c7709090-f7ea-45ac-8b46-336bdd903925 req-ead244a0-5a1b-4fd4-8115-09432e4f7cb8 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:01 user nova-compute[74892]: WARNING nova.compute.manager [req-c7709090-f7ea-45ac-8b46-336bdd903925 req-ead244a0-5a1b-4fd4-8115-09432e4f7cb8 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state resized and task_state resize_reverting.
Nov 15 14:23:01 user nova-compute[74892]: INFO nova.compute.manager [None req-4147bd01-3cba-4183-906a-158cf22a75e7 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance to original state: 'active'
Nov 15 14:23:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqyLdAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:23:06 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:23:06 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:23:06 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00bd283-6899-49f3-811c-8a0dd04f52d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:23:06 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bd73cc-77d3-4cbc-bb74-381d7b028878]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109] added
Nov 15 14:23:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9718a70e-d1ab-4684-b079-a9a06941b95b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0648b8d6-efd0-46f0-b188-9dc8e6111f85]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtqyLdAI {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtqyLdAI" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e9db69-316e-4d47-981c-051d5c9caa98]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtqyLdAI'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2f3709-5891-40ba-9071-178dc3acef25]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5db9c24-3a76-41cb-931b-1642e5760e72]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf631dd6-edc4-44fe-8d20-6cd83cb5c119]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260]
Nov 15 14:23:06 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260] successful.
Nov 15 14:23:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe9e03f-94b3-4643-a6d4-23500db9205c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[38144991-349b-4010-903d-083789300900]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:06 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:06 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4029134-346c-4856-b96f-fc27e8882d04]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqyLdAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:06 user nova-compute[74892]: INFO nova.compute.manager [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Terminating instance
Nov 15 14:23:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-a069e835-7434-454f-a988-7d4ef4cc9b8b req-d645effc-8188-4dc1-a2e4-85946e483108 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received event network-vif-unplugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a069e835-7434-454f-a988-7d4ef4cc9b8b req-d645effc-8188-4dc1-a2e4-85946e483108 service nova] Acquiring lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a069e835-7434-454f-a988-7d4ef4cc9b8b req-d645effc-8188-4dc1-a2e4-85946e483108 service nova] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a069e835-7434-454f-a988-7d4ef4cc9b8b req-d645effc-8188-4dc1-a2e4-85946e483108 service nova] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-a069e835-7434-454f-a988-7d4ef4cc9b8b req-d645effc-8188-4dc1-a2e4-85946e483108 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] No waiting events found dispatching network-vif-unplugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-a069e835-7434-454f-a988-7d4ef4cc9b8b req-d645effc-8188-4dc1-a2e4-85946e483108 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received event network-vif-unplugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23164373831373233', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164373831373233', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:23:07 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:23:07 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:23:07 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:23:07 user nova-compute[74892]:   <serial>817f9b79-ad7a-40e2-bcde-9be2b56ae109</serial>
Nov 15 14:23:07 user nova-compute[74892]: </disk>
Nov 15 14:23:07 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:23:07 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Instance destroyed successfully.
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lazy-loading 'resources' on Instance uuid a75e0d21-e9e0-4da9-a328-bac6aea1755c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1587713122',display_name='tempest-VolumesNegativeTest-instance-1587713122',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1587713122',id=18,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b56830838db45b1aa0621736a5ed53a',ramdisk_id='',reservation_id='r-jk4a3uq4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-754367886',owner_user_name='tempest-VolumesNegativeTest-754367886-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:21:24Z,user_data=None,user_id='ca983885487f44c589101440835f1f98',uuid=a75e0d21-e9e0-4da9-a328-bac6aea1755c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Converting VIF {"id": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "address": "fa:16:3e:41:e9:3e", "network": {"id": "ac396435-1680-422d-9905-e9162b29c5ee", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "11e30cf19ff944f2bcf84ce744b29155", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b615c02-ce", "ovs_interfaceid": "2b615c02-ce10-4a9f-8e2b-7a6bbc49170a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:e9:3e,bridge_name='br-int',has_traffic_filtering=True,id=2b615c02-ce10-4a9f-8e2b-7a6bbc49170a,network=Network(ac396435-1680-422d-9905-e9162b29c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b615c02-ce') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG os_vif [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e9:3e,bridge_name='br-int',has_traffic_filtering=True,id=2b615c02-ce10-4a9f-8e2b-7a6bbc49170a,network=Network(ac396435-1680-422d-9905-e9162b29c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b615c02-ce') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b615c02-ce, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e2fd776-3118-4193-ae1f-fd4679c8c6a4) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:07 user nova-compute[74892]: INFO os_vif [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:e9:3e,bridge_name='br-int',has_traffic_filtering=True,id=2b615c02-ce10-4a9f-8e2b-7a6bbc49170a,network=Network(ac396435-1680-422d-9905-e9162b29c5ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b615c02-ce')
Nov 15 14:23:07 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Deleting instance files /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c_del
Nov 15 14:23:07 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Deletion of /opt/stack/data/nova/instances/a75e0d21-e9e0-4da9-a328-bac6aea1755c_del complete
Nov 15 14:23:07 user nova-compute[74892]: INFO nova.compute.manager [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 14:23:07 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:23:07 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No VIF found with MAC fa:16:3e:2f:62:55, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4ac9d520-4015-4506-8075-16a34e147c5b tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.039s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-384d02e2-40e3-45cc-91c0-ec458611b3da req-70a81fb5-0cb9-4599-b3a5-bddeb21780b5 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received event network-vif-deleted-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:08 user nova-compute[74892]: INFO nova.compute.manager [req-384d02e2-40e3-45cc-91c0-ec458611b3da req-70a81fb5-0cb9-4599-b3a5-bddeb21780b5 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Neutron deleted interface 2b615c02-ce10-4a9f-8e2b-7a6bbc49170a; detaching it from the instance and deleting it from the info cache
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-384d02e2-40e3-45cc-91c0-ec458611b3da req-70a81fb5-0cb9-4599-b3a5-bddeb21780b5 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-384d02e2-40e3-45cc-91c0-ec458611b3da req-70a81fb5-0cb9-4599-b3a5-bddeb21780b5 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Detach interface failed, port_id=2b615c02-ce10-4a9f-8e2b-7a6bbc49170a, reason: Instance a75e0d21-e9e0-4da9-a328-bac6aea1755c could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:23:08 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Took 0.67 seconds to deallocate network for instance.
Nov 15 14:23:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:23:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:08 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Deleted allocations for instance a75e0d21-e9e0-4da9-a328-bac6aea1755c
Nov 15 14:23:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb7ae3e1-8c34-4665-b852-2b071905098d tempest-VolumesNegativeTest-754367886 tempest-VolumesNegativeTest-754367886-project-member] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.354s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG nova.compute.manager [req-f491e748-75a3-4f83-9daf-f18bfe066f1c req-7a507443-ca43-4bfa-b0ce-3a825c15bb71 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received event network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f491e748-75a3-4f83-9daf-f18bfe066f1c req-7a507443-ca43-4bfa-b0ce-3a825c15bb71 service nova] Acquiring lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f491e748-75a3-4f83-9daf-f18bfe066f1c req-7a507443-ca43-4bfa-b0ce-3a825c15bb71 service nova] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f491e748-75a3-4f83-9daf-f18bfe066f1c req-7a507443-ca43-4bfa-b0ce-3a825c15bb71 service nova] Lock "a75e0d21-e9e0-4da9-a328-bac6aea1755c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG nova.compute.manager [req-f491e748-75a3-4f83-9daf-f18bfe066f1c req-7a507443-ca43-4bfa-b0ce-3a825c15bb71 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] No waiting events found dispatching network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:09 user nova-compute[74892]: WARNING nova.compute.manager [req-f491e748-75a3-4f83-9daf-f18bfe066f1c req-7a507443-ca43-4bfa-b0ce-3a825c15bb71 service nova] [instance: a75e0d21-e9e0-4da9-a328-bac6aea1755c] Received unexpected event network-vif-plugged-2b615c02-ce10-4a9f-8e2b-7a6bbc49170a for instance with vm_state deleted and task_state None.
Nov 15 14:23:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04ff2788-f3a3-4423-ab64-ba2bc550ac2e tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04ff2788-f3a3-4423-ab64-ba2bc550ac2e tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-04ff2788-f3a3-4423-ab64-ba2bc550ac2e tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-04ff2788-f3a3-4423-ab64-ba2bc550ac2e tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74892) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-04ff2788-f3a3-4423-ab64-ba2bc550ac2e tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:10 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance destroyed successfully.
Nov 15 14:23:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-04ff2788-f3a3-4423-ab64-ba2bc550ac2e tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-04ff2788-f3a3-4423-ab64-ba2bc550ac2e tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.917s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG nova.compute.manager [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG nova.compute.manager [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:10 user nova-compute[74892]: WARNING nova.compute.manager [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state stopped and task_state None.
Nov 15 14:23:10 user nova-compute[74892]: DEBUG nova.compute.manager [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:10 user nova-compute[74892]: DEBUG nova.compute.manager [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:10 user nova-compute[74892]: WARNING nova.compute.manager [req-75efdb17-e9b2-4a1c-8943-db93db16aff4 req-bc1aae3c-f6ca-4ff9-ba50-9873328365a0 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state stopped and task_state None.
Nov 15 14:23:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG nova.objects.instance [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lazy-loading 'flavor' on Instance uuid 7287af69-2562-4bc2-8a9f-e3cf3bb0814f {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:21 user nova-compute[74892]: INFO nova.compute.manager [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Attaching volume 6f53db41-cdee-4297-b05c-dc2069bdd1e0 to /dev/vdb
Nov 15 14:23:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG os_brick.utils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[180abbc5-a721-46c1-80f1-9fbeabbefde3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd22a37-27ab-4acd-a94b-5cd8f0ebdc8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9907469-bc9a-46d2-9789-c440faccc1c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8633cb18-86e5-4ffa-a64f-900326e9a6da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:23:21 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fd78bf-c38c-4787-9122-2bce5cdf2e37]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG os_brick.utils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Updating existing volume attachment record: b442944d-79fd-4f1f-9ab1-8d64cb088064 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:23:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid a87f39af-29c7-40ee-86c9-ed04a07b9d2e {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 6c7fcea3-5818-4f0d-a0e8-91bef820d398 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 7287af69-2562-4bc2-8a9f-e3cf3bb0814f {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid d013f581-2c2a-4935-98d5-53b0904118ac {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid eb9a1c70-0015-4c2a-ae2e-4ec79b06b094 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 726e0f64-5808-4e5b-accf-190ed1537b44 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "45201330-05c4-4109-99c2-d17761f46add" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "45201330-05c4-4109-99c2-d17761f46add" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.162s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.180s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.177s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:22 user nova-compute[74892]: INFO nova.compute.manager [None req-5886ce78-3ca9-4f60-bb3a-d64613185662 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Unrescuing
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5886ce78-3ca9-4f60-bb3a-d64613185662 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5886ce78-3ca9-4f60-bb3a-d64613185662 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquired lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.network.neutron [None req-5886ce78-3ca9-4f60-bb3a-d64613185662 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:22 user nova-compute[74892]: INFO nova.compute.manager [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Terminating instance
Nov 15 14:23:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-25f3924d-7a8e-4d7d-80bd-46a19ae59a5d req-115e16e1-0163-4a2f-a682-8a6460f373f5 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-unplugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-25f3924d-7a8e-4d7d-80bd-46a19ae59a5d req-115e16e1-0163-4a2f-a682-8a6460f373f5 service nova] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-25f3924d-7a8e-4d7d-80bd-46a19ae59a5d req-115e16e1-0163-4a2f-a682-8a6460f373f5 service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-25f3924d-7a8e-4d7d-80bd-46a19ae59a5d req-115e16e1-0163-4a2f-a682-8a6460f373f5 service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-25f3924d-7a8e-4d7d-80bd-46a19ae59a5d req-115e16e1-0163-4a2f-a682-8a6460f373f5 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] No waiting events found dispatching network-vif-unplugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-25f3924d-7a8e-4d7d-80bd-46a19ae59a5d req-115e16e1-0163-4a2f-a682-8a6460f373f5 service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-unplugged-571e109b-b616-4b07-84af-97aac4371356 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-5886ce78-3ca9-4f60-bb3a-d64613185662 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating instance_info_cache with network_info: [{"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5886ce78-3ca9-4f60-bb3a-d64613185662 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Releasing lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.objects.instance [None req-5886ce78-3ca9-4f60-bb3a-d64613185662 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'flavor' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Instance destroyed successfully.
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'resources' on Instance uuid ffa60aac-02a4-42ab-b97b-b9cc56079e44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1702806374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1702806374',id=4,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcKO71oeZrgy6wz9s/wPxza901ZFMNKyl2MUdIi82+6RHq4oQxD7hsBGsnSKky8SJzUR8AZKzc+Nx4KVU1pFWiG2B+khnBeJ7VgrHzCGzypwZl4fbObFWScYtHqED6u+w==',key_name='tempest-keypair-1680936907',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ryzg4t4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=ffa60aac-02a4-42ab-b97b-b9cc56079e44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "571e109b-b616-4b07-84af-97aac4371356", "address": "fa:16:3e:2e:95:f5", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap571e109b-b6", "ovs_interfaceid": "571e109b-b616-4b07-84af-97aac4371356", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG os_vif [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap571e109b-b6, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b4be3cd-81b8-48d1-a105-f3dbc3a2481c) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: INFO os_vif [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:95:f5,bridge_name='br-int',has_traffic_filtering=True,id=571e109b-b616-4b07-84af-97aac4371356,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap571e109b-b6')
Nov 15 14:23:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Deleting instance files /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44_del
Nov 15 14:23:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Deletion of /opt/stack/data/nova/instances/ffa60aac-02a4-42ab-b97b-b9cc56079e44_del complete
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: INFO nova.compute.manager [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 14:23:23 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:24 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance destroyed successfully.
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:25 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Took 1.66 seconds to deallocate network for instance.
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Acquiring lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] No waiting events found dispatching network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:25 user nova-compute[74892]: WARNING nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received unexpected event network-vif-plugged-571e109b-b616-4b07-84af-97aac4371356 for instance with vm_state deleted and task_state None.
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:25 user nova-compute[74892]: WARNING nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:25 user nova-compute[74892]: WARNING nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-59aa40a3-05f4-4665-9a97-28f6e4d76f6c req-d29e58d1-1cef-40d6-b0ed-79dc5cdf13ce service nova] [instance: ffa60aac-02a4-42ab-b97b-b9cc56079e44] Received event network-vif-deleted-571e109b-b616-4b07-84af-97aac4371356 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:25 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Deleted allocations for instance ffa60aac-02a4-42ab-b97b-b9cc56079e44
Nov 15 14:23:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4dbce298-acb9-4df9-921d-373ad1615700 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "ffa60aac-02a4-42ab-b97b-b9cc56079e44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.271s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZbQUexF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:23:26 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:23:26 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:23:26 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d87673-d233-4fae-a0ec-15ca79812cc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:23:26 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614f301-cecd-442a-a745-5237c337992d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0] added
Nov 15 14:23:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ce5735-1dca-49ad-aeb0-098eb923d031]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6193d-9922-414d-835b-4081a156aa00]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZbQUexF {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZbQUexF" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1671ec61-e253-4f39-992f-99e0a1ce25dc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LZbQUexF'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb7f12f-c591-4ecb-9dbf-c31d7da52890]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58b66ab-7dff-4771-8e8c-9bbaf168fc08]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b783effa-150a-4a2d-965b-6b2725faf871]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0, portal: 172.16.0.220,3260]
Nov 15 14:23:26 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0, portal: 172.16.0.220,3260] successful.
Nov 15 14:23:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddd3006-0096-4c54-a347-01bd6ee4b51e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed76323-cbeb-4054-bf9e-6376c0dd8a0a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 (non-flash)
Nov 15 14:23:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:23:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[607b0cd5-6726-4dfb-b31d-e86dad9a8539]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:27 user nova-compute[74892]: WARNING nova.compute.manager [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:23:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:27 user nova-compute[74892]: WARNING nova.compute.manager [req-2a84b00c-09f6-4224-91de-886a8aaa9288 req-b8e4eb20-f78b-47d7-9558-4497ed357fbc service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:23:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZbQUexF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26464393061383430', 'path': '/dev/sdf'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464393061383430', 'path': '/dev/sdf'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG nova.objects.instance [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lazy-loading 'flavor' on Instance uuid 7287af69-2562-4bc2-8a9f-e3cf3bb0814f {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-5886ce78-3ca9-4f60-bb3a-d64613185662 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:23:28 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:23:28 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:23:28 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:23:28 user nova-compute[74892]:   <serial>6f53db41-cdee-4297-b05c-dc2069bdd1e0</serial>
Nov 15 14:23:28 user nova-compute[74892]: </disk>
Nov 15 14:23:28 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] No VIF found with MAC fa:16:3e:9e:ef:6e, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-685033ca-979d-4fcf-a146-9939a39e6e7c tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.375s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.738s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:29 user nova-compute[74892]: INFO nova.compute.manager [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Terminating instance
Nov 15 14:23:29 user nova-compute[74892]: DEBUG nova.compute.manager [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Instance destroyed successfully.
Nov 15 14:23:29 user nova-compute[74892]: DEBUG nova.objects.instance [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lazy-loading 'resources' on Instance uuid 7287af69-2562-4bc2-8a9f-e3cf3bb0814f {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1093685128',display_name='tempest-DeleteServersTestJSON-server-1093685128',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1093685128',id=19,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3146264c419041bb93c25b81c316b7c7',ramdisk_id='',reservation_id='r-wlenvpn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-131353425',owner_user_name='tempest-DeleteServersTestJSON-131353425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:21:40Z,user_data=None,user_id='577942c6b851420b9a197a950e116021',uuid=7287af69-2562-4bc2-8a9f-e3cf3bb0814f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Converting VIF {"id": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "address": "fa:16:3e:9e:ef:6e", "network": {"id": "6dd7861b-9458-49dc-84a3-43c9c99f4894", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1866134303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3146264c419041bb93c25b81c316b7c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02aa64ff-75", "ovs_interfaceid": "02aa64ff-75e0-4dfa-80b9-32db327b1f5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:6e,bridge_name='br-int',has_traffic_filtering=True,id=02aa64ff-75e0-4dfa-80b9-32db327b1f5d,network=Network(6dd7861b-9458-49dc-84a3-43c9c99f4894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa64ff-75') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG os_vif [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:6e,bridge_name='br-int',has_traffic_filtering=True,id=02aa64ff-75e0-4dfa-80b9-32db327b1f5d,network=Network(6dd7861b-9458-49dc-84a3-43c9c99f4894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa64ff-75') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02aa64ff-75, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d9601b6-78fc-4423-bc0c-a3a8aa8cbf34) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:29 user nova-compute[74892]: INFO os_vif [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:6e,bridge_name='br-int',has_traffic_filtering=True,id=02aa64ff-75e0-4dfa-80b9-32db327b1f5d,network=Network(6dd7861b-9458-49dc-84a3-43c9c99f4894),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02aa64ff-75')
Nov 15 14:23:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZbQUexF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:23:29 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:23:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[30225c9b-7008-4074-8111-e9a925dba8f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:23:29 user nova-compute[74892]: No targets found.
Nov 15 14:23:29 user nova-compute[74892]: iSNS:
Nov 15 14:23:29 user nova-compute[74892]: No targets found.
Nov 15 14:23:29 user nova-compute[74892]: STATIC:
Nov 15 14:23:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc
Nov 15 14:23:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:23:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:23:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:23:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:23:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:23:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8
Nov 15 14:23:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:23:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:23:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0
Nov 15 14:23:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:23:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:23:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:23:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:23:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:23:29 user nova-compute[74892]: FIRMWARE:
Nov 15 14:23:29 user nova-compute[74892]: No targets found.
Nov 15 14:23:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:23:29 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:23:29 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed66776d-d4b3-4c0e-8e68-983edbf7f855]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f24f4-6c0e-4425-8757-278af7948923]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:30 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:30 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:30 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:30 user nova-compute[74892]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 (non-flash)
Nov 15 14:23:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:30 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:30 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:30 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:30 user nova-compute[74892]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 (non-flash)
Nov 15 14:23:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd006e45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0'): ({'sdf'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Removing single pathed devices sdf {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abac11f-85bd-46b8-9797-7c96f0c7f025]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[422602e7-04c7-48d7-82da-250f14e0a76e]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Flushing IO for device /dev/sdf {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dd6af3-51e5-4276-b3c2-f43234841863]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f82efeb-b489-4349-a82d-a60e1e619796]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc02e6a7-8635-4c1b-9b98-a7fe916fae6b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38f4439-dcad-4a55-bffe-4ea87401d081]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0, portal: 172.16.0.220,3260]
Nov 15 14:23:30 user nova-compute[74892]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0, portal: 172.16.0.220,3260] successful.
Nov 15 14:23:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f53db41-cdee-4297-b05c-dc2069bdd1e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d915c1a6-99d4-4456-9d52-8785cd78884d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] <== disconnect_volume: return (298ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:23:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Deleting instance files /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f_del
Nov 15 14:23:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Deletion of /opt/stack/data/nova/instances/7287af69-2562-4bc2-8a9f-e3cf3bb0814f_del complete
Nov 15 14:23:30 user nova-compute[74892]: INFO nova.compute.manager [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 14:23:30 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:23:30 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:30 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Took 0.43 seconds to deallocate network for instance.
Nov 15 14:23:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-a91612c5-83c4-490b-a986-6a670de40390 req-a2ab1062-b56d-49da-b2fb-db35c95f1b2f service nova] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Received event network-vif-deleted-02aa64ff-75e0-4dfa-80b9-32db327b1f5d {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:31 user nova-compute[74892]: INFO nova.compute.manager [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] [instance: 7287af69-2562-4bc2-8a9f-e3cf3bb0814f] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 14:23:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:31 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:23:31 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:23:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:31 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Deleted allocations for instance 7287af69-2562-4bc2-8a9f-e3cf3bb0814f
Nov 15 14:23:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03e0254f-858c-4c2e-88ea-4988367f3fb6 tempest-DeleteServersTestJSON-131353425 tempest-DeleteServersTestJSON-131353425-project-member] Lock "7287af69-2562-4bc2-8a9f-e3cf3bb0814f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.863s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:23:35 user nova-compute[74892]: INFO nova.compute.claims [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Claim successful on node user
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.network.neutron [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:23:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:23:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Creating image(s)
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "/opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "/opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:35 user nova-compute[74892]: DEBUG nova.policy [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6bb6050e1514d048c7bf60d2a45a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5a1be2c05744b98fb9c6f7176c2da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk 1073741824" returned: 0 in 0.048s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG nova.network.neutron [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Successfully created port: f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Cannot resize image /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Ensure instance console log exists: /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Successfully updated port: f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquired lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-02f959e8-bcdf-4352-af35-156fbdb43b43 req-52baa1bb-bd48-42b4-ad03-227629c21a79 service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-changed-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-02f959e8-bcdf-4352-af35-156fbdb43b43 req-52baa1bb-bd48-42b4-ad03-227629c21a79 service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Refreshing instance network info cache due to event network-changed-f43c2ae9-479a-4103-b661-c3a715ff9540. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02f959e8-bcdf-4352-af35-156fbdb43b43 req-52baa1bb-bd48-42b4-ad03-227629c21a79 service nova] Acquiring lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Updating instance_info_cache with network_info: [{"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Releasing lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Instance network_info: |[{"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02f959e8-bcdf-4352-af35-156fbdb43b43 req-52baa1bb-bd48-42b4-ad03-227629c21a79 service nova] Acquired lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.neutron [req-02f959e8-bcdf-4352-af35-156fbdb43b43 req-52baa1bb-bd48-42b4-ad03-227629c21a79 service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Refreshing network info cache for port f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Start _get_guest_xml network_info=[{"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:23:37 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:23:37 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-72f383e5-5d48-493e-aac1-742242187ca8 req-ad50dcc1-9a79-4032-824e-70dd403dafb4 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received event network-changed-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-72f383e5-5d48-493e-aac1-742242187ca8 req-ad50dcc1-9a79-4032-824e-70dd403dafb4 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Refreshing instance network info cache due to event network-changed-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-72f383e5-5d48-493e-aac1-742242187ca8 req-ad50dcc1-9a79-4032-824e-70dd403dafb4 service nova] Acquiring lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-72f383e5-5d48-493e-aac1-742242187ca8 req-ad50dcc1-9a79-4032-824e-70dd403dafb4 service nova] Acquired lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.neutron [req-72f383e5-5d48-493e-aac1-742242187ca8 req-ad50dcc1-9a79-4032-824e-70dd403dafb4 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Refreshing network info cache for port 65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1549144006',display_name='tempest-VolumesSnapshotTestJSON-instance-1549144006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1549144006',id=23,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJVfW938uBmsVGRkqe4ysEMCGGxEA2U5UW4qhYcnoFpBxjiySDRZbfwc6EH1F31UATWsnpFg+2DhWPc07beCAwMRPS/PGC9OHAwKauf8kakX0EjxPZxWX/U+CbeGa6wBw==',key_name='tempest-keypair-91959674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f5a1be2c05744b98fb9c6f7176c2da2',ramdisk_id='',reservation_id='r-bsnlncdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1165101863',owner_user_name='tempest-VolumesSnapshotTestJSON-1165101863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:23:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6bb6050e1514d048c7bf60d2a45a8e9',uuid=ae627049-158a-4e50-9e9b-29fc7992345d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converting VIF {"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=f43c2ae9-479a-4103-b661-c3a715ff9540,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43c2ae9-47') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.objects.instance [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'pci_devices' on Instance uuid ae627049-158a-4e50-9e9b-29fc7992345d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:23:37 user nova-compute[74892]:   <uuid>ae627049-158a-4e50-9e9b-29fc7992345d</uuid>
Nov 15 14:23:37 user nova-compute[74892]:   <name>instance-00000017</name>
Nov 15 14:23:37 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:23:37 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:23:37 user nova-compute[74892]:   <metadata>
Nov 15 14:23:37 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:23:37 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:23:37 user nova-compute[74892]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1549144006</nova:name>
Nov 15 14:23:37 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:23:37</nova:creationTime>
Nov 15 14:23:37 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:23:37 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:23:37 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:23:37 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:23:37 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:23:37 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:23:37 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:23:37 user nova-compute[74892]:       <nova:owner>
Nov 15 14:23:37 user nova-compute[74892]:         <nova:user uuid="d6bb6050e1514d048c7bf60d2a45a8e9">tempest-VolumesSnapshotTestJSON-1165101863-project-member</nova:user>
Nov 15 14:23:37 user nova-compute[74892]:         <nova:project uuid="2f5a1be2c05744b98fb9c6f7176c2da2">tempest-VolumesSnapshotTestJSON-1165101863</nova:project>
Nov 15 14:23:37 user nova-compute[74892]:       </nova:owner>
Nov 15 14:23:37 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:23:37 user nova-compute[74892]:       <nova:ports>
Nov 15 14:23:37 user nova-compute[74892]:         <nova:port uuid="f43c2ae9-479a-4103-b661-c3a715ff9540">
Nov 15 14:23:37 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 14:23:37 user nova-compute[74892]:         </nova:port>
Nov 15 14:23:37 user nova-compute[74892]:       </nova:ports>
Nov 15 14:23:37 user nova-compute[74892]:     </nova:instance>
Nov 15 14:23:37 user nova-compute[74892]:   </metadata>
Nov 15 14:23:37 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:23:37 user nova-compute[74892]:     <system>
Nov 15 14:23:37 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:23:37 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:23:37 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:23:37 user nova-compute[74892]:       <entry name="serial">ae627049-158a-4e50-9e9b-29fc7992345d</entry>
Nov 15 14:23:37 user nova-compute[74892]:       <entry name="uuid">ae627049-158a-4e50-9e9b-29fc7992345d</entry>
Nov 15 14:23:37 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:23:37 user nova-compute[74892]:     </system>
Nov 15 14:23:37 user nova-compute[74892]:   </sysinfo>
Nov 15 14:23:37 user nova-compute[74892]:   <os>
Nov 15 14:23:37 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:23:37 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:23:37 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:23:37 user nova-compute[74892]:   </os>
Nov 15 14:23:37 user nova-compute[74892]:   <features>
Nov 15 14:23:37 user nova-compute[74892]:     <acpi/>
Nov 15 14:23:37 user nova-compute[74892]:     <apic/>
Nov 15 14:23:37 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:23:37 user nova-compute[74892]:   </features>
Nov 15 14:23:37 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:23:37 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:23:37 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:23:37 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:23:37 user nova-compute[74892]:   </clock>
Nov 15 14:23:37 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:23:37 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:23:37 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:23:37 user nova-compute[74892]:   </cpu>
Nov 15 14:23:37 user nova-compute[74892]:   <devices>
Nov 15 14:23:37 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:23:37 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:23:37 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk"/>
Nov 15 14:23:37 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:23:37 user nova-compute[74892]:     </disk>
Nov 15 14:23:37 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:23:37 user nova-compute[74892]:       <mac address="fa:16:3e:36:c6:df"/>
Nov 15 14:23:37 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:23:37 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:23:37 user nova-compute[74892]:       <target dev="tapf43c2ae9-47"/>
Nov 15 14:23:37 user nova-compute[74892]:     </interface>
Nov 15 14:23:37 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:23:37 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/console.log" append="off"/>
Nov 15 14:23:37 user nova-compute[74892]:     </serial>
Nov 15 14:23:37 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:23:37 user nova-compute[74892]:     <video>
Nov 15 14:23:37 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:23:37 user nova-compute[74892]:     </video>
Nov 15 14:23:37 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:23:37 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:23:37 user nova-compute[74892]:     </rng>
Nov 15 14:23:37 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:23:37 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:23:37 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:23:37 user nova-compute[74892]:     </memballoon>
Nov 15 14:23:37 user nova-compute[74892]:   </devices>
Nov 15 14:23:37 user nova-compute[74892]: </domain>
Nov 15 14:23:37 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1549144006',display_name='tempest-VolumesSnapshotTestJSON-instance-1549144006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1549144006',id=23,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJVfW938uBmsVGRkqe4ysEMCGGxEA2U5UW4qhYcnoFpBxjiySDRZbfwc6EH1F31UATWsnpFg+2DhWPc07beCAwMRPS/PGC9OHAwKauf8kakX0EjxPZxWX/U+CbeGa6wBw==',key_name='tempest-keypair-91959674',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f5a1be2c05744b98fb9c6f7176c2da2',ramdisk_id='',reservation_id='r-bsnlncdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1165101863',owner_user_name='tempest-VolumesSnapshotTestJSON-1165101863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:23:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6bb6050e1514d048c7bf60d2a45a8e9',uuid=ae627049-158a-4e50-9e9b-29fc7992345d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converting VIF {"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=f43c2ae9-479a-4103-b661-c3a715ff9540,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43c2ae9-47') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG os_vif [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=f43c2ae9-479a-4103-b661-c3a715ff9540,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43c2ae9-47') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ebaf517-89a8-56ca-b796-724a6e34c001', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf43c2ae9-47, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf43c2ae9-47, col_values=(('qos', UUID('5f55e0d9-6c3e-42f9-b904-7ee79e8f0cac')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf43c2ae9-47, col_values=(('external_ids', {'iface-id': 'f43c2ae9-479a-4103-b661-c3a715ff9540', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:c6:df', 'vm-uuid': 'ae627049-158a-4e50-9e9b-29fc7992345d'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:37 user nova-compute[74892]: INFO os_vif [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=f43c2ae9-479a-4103-b661-c3a715ff9540,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43c2ae9-47')
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No VIF found with MAC fa:16:3e:36:c6:df, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.neutron [req-02f959e8-bcdf-4352-af35-156fbdb43b43 req-52baa1bb-bd48-42b4-ad03-227629c21a79 service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Updated VIF entry in instance network info cache for port f43c2ae9-479a-4103-b661-c3a715ff9540. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG nova.network.neutron [req-02f959e8-bcdf-4352-af35-156fbdb43b43 req-52baa1bb-bd48-42b4-ad03-227629c21a79 service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Updating instance_info_cache with network_info: [{"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02f959e8-bcdf-4352-af35-156fbdb43b43 req-52baa1bb-bd48-42b4-ad03-227629c21a79 service nova] Releasing lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG nova.network.neutron [req-72f383e5-5d48-493e-aac1-742242187ca8 req-ad50dcc1-9a79-4032-824e-70dd403dafb4 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Updated VIF entry in instance network info cache for port 65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG nova.network.neutron [req-72f383e5-5d48-493e-aac1-742242187ca8 req-ad50dcc1-9a79-4032-824e-70dd403dafb4 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Updating instance_info_cache with network_info: [{"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-72f383e5-5d48-493e-aac1-742242187ca8 req-ad50dcc1-9a79-4032-824e-70dd403dafb4 service nova] Releasing lock "refresh_cache-d013f581-2c2a-4935-98d5-53b0904118ac" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:23:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid d013f581-2c2a-4935-98d5-53b0904118ac {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:39 user nova-compute[74892]: INFO nova.compute.manager [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Attaching volume 3156fb95-a143-4029-a1a9-c583b5de53dc to /dev/vdb
Nov 15 14:23:39 user nova-compute[74892]: DEBUG os_brick.utils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0593f44-084c-4ed1-a9d6-ae011aa0b24f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-22dfc6b6-1922-4f79-962b-8f847ea010c8 req-109cff69-7abe-4ef6-9438-eebde4c5f84b service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-22dfc6b6-1922-4f79-962b-8f847ea010c8 req-109cff69-7abe-4ef6-9438-eebde4c5f84b service nova] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-22dfc6b6-1922-4f79-962b-8f847ea010c8 req-109cff69-7abe-4ef6-9438-eebde4c5f84b service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-22dfc6b6-1922-4f79-962b-8f847ea010c8 req-109cff69-7abe-4ef6-9438-eebde4c5f84b service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-22dfc6b6-1922-4f79-962b-8f847ea010c8 req-109cff69-7abe-4ef6-9438-eebde4c5f84b service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] No waiting events found dispatching network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:39 user nova-compute[74892]: WARNING nova.compute.manager [req-22dfc6b6-1922-4f79-962b-8f847ea010c8 req-109cff69-7abe-4ef6-9438-eebde4c5f84b service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received unexpected event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 for instance with vm_state building and task_state spawning.
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9178b21d-c60b-4b2b-92cb-f501e1b99233]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19e8f50-60eb-4127-aa28-3db178747d85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f164001b-0943-45f8-a3b0-e14dee6b1ebb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:23:39 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd69d3ee-c781-4d2b-bc4b-1b226028da4f]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG os_brick.utils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Updating existing volume attachment record: f3c90768-f34a-4aca-b0ee-3da0f1da7718 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:23:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:23:41 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Instance spawned successfully.
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:41 user nova-compute[74892]: INFO nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:41 user nova-compute[74892]: INFO nova.compute.manager [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Took 6.25 seconds to build instance.
Nov 15 14:23:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-530929f2-4b4c-4514-b141-ff3e4164323d tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.499s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-f1462ba7-0449-457c-ac51-361dd2b8e8cc req-ecba8d29-3bbc-4da5-855b-333eb1d6cb48 service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f1462ba7-0449-457c-ac51-361dd2b8e8cc req-ecba8d29-3bbc-4da5-855b-333eb1d6cb48 service nova] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f1462ba7-0449-457c-ac51-361dd2b8e8cc req-ecba8d29-3bbc-4da5-855b-333eb1d6cb48 service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f1462ba7-0449-457c-ac51-361dd2b8e8cc req-ecba8d29-3bbc-4da5-855b-333eb1d6cb48 service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-f1462ba7-0449-457c-ac51-361dd2b8e8cc req-ecba8d29-3bbc-4da5-855b-333eb1d6cb48 service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] No waiting events found dispatching network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:41 user nova-compute[74892]: WARNING nova.compute.manager [req-f1462ba7-0449-457c-ac51-361dd2b8e8cc req-ecba8d29-3bbc-4da5-855b-333eb1d6cb48 service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received unexpected event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 for instance with vm_state active and task_state None.
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:23:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7553MB free_disk=25.24563217163086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 726e0f64-5808-4e5b-accf-190ed1537b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d013f581-2c2a-4935-98d5-53b0904118ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9e258725-b58a-46c8-a2f0-099e246564a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance eb9a1c70-0015-4c2a-ae2e-4ec79b06b094 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ae627049-158a-4e50-9e9b-29fc7992345d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:23:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaFsxWnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:23:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:23:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:23:44 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[901b9870-c8da-4589-9e31-1f819ad5eb21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:23:44 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[16881208-4195-4e2f-83ac-a5d552d3377d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc] added
Nov 15 14:23:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1fea6d-4561-4ca6-a18a-336cf07d73ae]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8d1f4d-d74e-406a-853e-41f000bcff3b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZaFsxWnX {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZaFsxWnX" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf249645-8a9f-4d68-8dc7-6ea4fc66d30c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZaFsxWnX'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57c9f3d-e5c3-4fd0-b7f2-84099e0d83a8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b7e5b-3580-4dd2-bade-a0aa43c1362f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e65928e-f8db-4433-ae4d-340290427bb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc, portal: 172.16.0.220,3260]
Nov 15 14:23:44 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc, portal: 172.16.0.220,3260] successful.
Nov 15 14:23:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8871f5-b6af-461c-b1e7-da6c165d7d1a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70b90ff-47bd-4886-9759-3945bd3e16ae]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:23:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:23:44 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:23:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d3fd1f-f440-4e91-b9b1-680b77ab6ef3]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:23:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaFsxWnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:23:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:23:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23330623764396332', 'path': '/dev/sdf'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:23:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330623764396332', 'path': '/dev/sdf'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:23:45 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid d013f581-2c2a-4935-98d5-53b0904118ac {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:23:46 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:23:46 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:23:46 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:23:46 user nova-compute[74892]:   <serial>3156fb95-a143-4029-a1a9-c583b5de53dc</serial>
Nov 15 14:23:46 user nova-compute[74892]: </disk>
Nov 15 14:23:46 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No VIF found with MAC fa:16:3e:d9:17:f7, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd713ccd-a8e2-4602-aab3-4e72bb965873 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.137s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-fa10bdb2-3eaf-43b2-a09f-63f40a3caece req-d7ee5777-6587-400a-ac83-039dfe28d3cf service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-changed-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-fa10bdb2-3eaf-43b2-a09f-63f40a3caece req-d7ee5777-6587-400a-ac83-039dfe28d3cf service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Refreshing instance network info cache due to event network-changed-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fa10bdb2-3eaf-43b2-a09f-63f40a3caece req-d7ee5777-6587-400a-ac83-039dfe28d3cf service nova] Acquiring lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fa10bdb2-3eaf-43b2-a09f-63f40a3caece req-d7ee5777-6587-400a-ac83-039dfe28d3cf service nova] Acquired lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:23:46 user nova-compute[74892]: DEBUG nova.network.neutron [req-fa10bdb2-3eaf-43b2-a09f-63f40a3caece req-d7ee5777-6587-400a-ac83-039dfe28d3cf service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Refreshing network info cache for port ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:23:47 user nova-compute[74892]: DEBUG nova.network.neutron [req-fa10bdb2-3eaf-43b2-a09f-63f40a3caece req-d7ee5777-6587-400a-ac83-039dfe28d3cf service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updated VIF entry in instance network info cache for port ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:23:47 user nova-compute[74892]: DEBUG nova.network.neutron [req-fa10bdb2-3eaf-43b2-a09f-63f40a3caece req-d7ee5777-6587-400a-ac83-039dfe28d3cf service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fa10bdb2-3eaf-43b2-a09f-63f40a3caece req-d7ee5777-6587-400a-ac83-039dfe28d3cf service nova] Releasing lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:23:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:23:48 user nova-compute[74892]: INFO nova.compute.manager [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] instance snapshotting
Nov 15 14:23:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Beginning live snapshot process
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json -f qcow2 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json -f qcow2 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpppedncto/376c286d94354b6095cc3c73e1cde0a8.delta 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [{"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpppedncto/376c286d94354b6095cc3c73e1cde0a8.delta 1073741824" returned: 0 in 0.054s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-2cd7a807-53cb-44d6-91cd-3a58b36f2963" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:23:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:23:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:23:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] COPY block job progress, current cursor: 11206656 final cursor: 75497472 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:23:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:23:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 14:23:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "39653e2d-4446-4d30-a787-d16c9f5ca47f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:23:50 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:23:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpppedncto/376c286d94354b6095cc3c73e1cde0a8.delta /opt/stack/data/nova/instances/snapshots/tmpppedncto/376c286d94354b6095cc3c73e1cde0a8 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:23:51 user nova-compute[74892]: INFO nova.compute.claims [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Claim successful on node user
Nov 15 14:23:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpppedncto/376c286d94354b6095cc3c73e1cde0a8.delta /opt/stack/data/nova/instances/snapshots/tmpppedncto/376c286d94354b6095cc3c73e1cde0a8" returned: 0 in 0.680s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Snapshot extracted, beginning image upload
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:23:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.policy [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '494e2c6ede5c47ed8af6d1399ad8a06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d5b81e2d940589392aa33ffb900e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:23:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Creating image(s)
Nov 15 14:23:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "/opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "/opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "/opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.295s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk 1073741824" returned: 0 in 0.053s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.214s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Successfully created port: 35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Cannot resize image /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Ensure instance console log exists: /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Successfully updated port: 35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquired lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-99d8ad5d-5673-4b79-8c6f-f6afd080800d req-11a2d197-f3d4-41ef-a5c0-071a58c9e3cc service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received event network-changed-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-99d8ad5d-5673-4b79-8c6f-f6afd080800d req-11a2d197-f3d4-41ef-a5c0-071a58c9e3cc service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Refreshing instance network info cache due to event network-changed-35491745-14cd-4e95-8217-6a0f6fc2bb55. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-99d8ad5d-5673-4b79-8c6f-f6afd080800d req-11a2d197-f3d4-41ef-a5c0-071a58c9e3cc service nova] Acquiring lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Updating instance_info_cache with network_info: [{"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Releasing lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Instance network_info: |[{"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-99d8ad5d-5673-4b79-8c6f-f6afd080800d req-11a2d197-f3d4-41ef-a5c0-071a58c9e3cc service nova] Acquired lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.network.neutron [req-99d8ad5d-5673-4b79-8c6f-f6afd080800d req-11a2d197-f3d4-41ef-a5c0-071a58c9e3cc service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Refreshing network info cache for port 35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Start _get_guest_xml network_info=[{"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:23:53 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:23:53 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:23:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518539722',display_name='tempest-AttachVolumeNegativeTest-server-518539722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518539722',id=24,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJAjn7VUL6jvRCDmdfvXFM97ElpeKQ2z20LPBeNKrIYQovqaBl2FXtnEjb2KTWnElzDpoSQ9LjtEtNOpXLyVZBueYWYm1O+BaeZG0pCRdJZUCTnNuDSFIVXQA1zU0gWKw==',key_name='tempest-keypair-11583283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-h151loq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=39653e2d-4446-4d30-a787-d16c9f5ca47f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:25,bridge_name='br-int',has_traffic_filtering=True,id=35491745-14cd-4e95-8217-6a0f6fc2bb55,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35491745-14') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'pci_devices' on Instance uuid 39653e2d-4446-4d30-a787-d16c9f5ca47f {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:23:54 user nova-compute[74892]:   <uuid>39653e2d-4446-4d30-a787-d16c9f5ca47f</uuid>
Nov 15 14:23:54 user nova-compute[74892]:   <name>instance-00000018</name>
Nov 15 14:23:54 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:23:54 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:23:54 user nova-compute[74892]:   <metadata>
Nov 15 14:23:54 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:23:54 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:23:54 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeNegativeTest-server-518539722</nova:name>
Nov 15 14:23:54 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:23:53</nova:creationTime>
Nov 15 14:23:54 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:23:54 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:23:54 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:23:54 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:23:54 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:23:54 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:23:54 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:23:54 user nova-compute[74892]:       <nova:owner>
Nov 15 14:23:54 user nova-compute[74892]:         <nova:user uuid="494e2c6ede5c47ed8af6d1399ad8a06a">tempest-AttachVolumeNegativeTest-2132166828-project-member</nova:user>
Nov 15 14:23:54 user nova-compute[74892]:         <nova:project uuid="6c2d5b81e2d940589392aa33ffb900e2">tempest-AttachVolumeNegativeTest-2132166828</nova:project>
Nov 15 14:23:54 user nova-compute[74892]:       </nova:owner>
Nov 15 14:23:54 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:23:54 user nova-compute[74892]:       <nova:ports>
Nov 15 14:23:54 user nova-compute[74892]:         <nova:port uuid="35491745-14cd-4e95-8217-6a0f6fc2bb55">
Nov 15 14:23:54 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:23:54 user nova-compute[74892]:         </nova:port>
Nov 15 14:23:54 user nova-compute[74892]:       </nova:ports>
Nov 15 14:23:54 user nova-compute[74892]:     </nova:instance>
Nov 15 14:23:54 user nova-compute[74892]:   </metadata>
Nov 15 14:23:54 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:23:54 user nova-compute[74892]:     <system>
Nov 15 14:23:54 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:23:54 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:23:54 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:23:54 user nova-compute[74892]:       <entry name="serial">39653e2d-4446-4d30-a787-d16c9f5ca47f</entry>
Nov 15 14:23:54 user nova-compute[74892]:       <entry name="uuid">39653e2d-4446-4d30-a787-d16c9f5ca47f</entry>
Nov 15 14:23:54 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:23:54 user nova-compute[74892]:     </system>
Nov 15 14:23:54 user nova-compute[74892]:   </sysinfo>
Nov 15 14:23:54 user nova-compute[74892]:   <os>
Nov 15 14:23:54 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:23:54 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:23:54 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:23:54 user nova-compute[74892]:   </os>
Nov 15 14:23:54 user nova-compute[74892]:   <features>
Nov 15 14:23:54 user nova-compute[74892]:     <acpi/>
Nov 15 14:23:54 user nova-compute[74892]:     <apic/>
Nov 15 14:23:54 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:23:54 user nova-compute[74892]:   </features>
Nov 15 14:23:54 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:23:54 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:23:54 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:23:54 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:23:54 user nova-compute[74892]:   </clock>
Nov 15 14:23:54 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:23:54 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:23:54 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:23:54 user nova-compute[74892]:   </cpu>
Nov 15 14:23:54 user nova-compute[74892]:   <devices>
Nov 15 14:23:54 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:23:54 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:23:54 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk"/>
Nov 15 14:23:54 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:23:54 user nova-compute[74892]:     </disk>
Nov 15 14:23:54 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:23:54 user nova-compute[74892]:       <mac address="fa:16:3e:ea:30:25"/>
Nov 15 14:23:54 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:23:54 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:23:54 user nova-compute[74892]:       <target dev="tap35491745-14"/>
Nov 15 14:23:54 user nova-compute[74892]:     </interface>
Nov 15 14:23:54 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:23:54 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/console.log" append="off"/>
Nov 15 14:23:54 user nova-compute[74892]:     </serial>
Nov 15 14:23:54 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:23:54 user nova-compute[74892]:     <video>
Nov 15 14:23:54 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:23:54 user nova-compute[74892]:     </video>
Nov 15 14:23:54 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:23:54 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:23:54 user nova-compute[74892]:     </rng>
Nov 15 14:23:54 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:23:54 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:23:54 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:23:54 user nova-compute[74892]:     </memballoon>
Nov 15 14:23:54 user nova-compute[74892]:   </devices>
Nov 15 14:23:54 user nova-compute[74892]: </domain>
Nov 15 14:23:54 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518539722',display_name='tempest-AttachVolumeNegativeTest-server-518539722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518539722',id=24,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJAjn7VUL6jvRCDmdfvXFM97ElpeKQ2z20LPBeNKrIYQovqaBl2FXtnEjb2KTWnElzDpoSQ9LjtEtNOpXLyVZBueYWYm1O+BaeZG0pCRdJZUCTnNuDSFIVXQA1zU0gWKw==',key_name='tempest-keypair-11583283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-h151loq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:23:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=39653e2d-4446-4d30-a787-d16c9f5ca47f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:25,bridge_name='br-int',has_traffic_filtering=True,id=35491745-14cd-4e95-8217-6a0f6fc2bb55,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35491745-14') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG os_vif [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:25,bridge_name='br-int',has_traffic_filtering=True,id=35491745-14cd-4e95-8217-6a0f6fc2bb55,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35491745-14') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0157c01d-f6eb-5a43-85b5-2e018bee0794', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35491745-14, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap35491745-14, col_values=(('qos', UUID('248d5031-b589-4d68-ab6f-6ac44561089d')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap35491745-14, col_values=(('external_ids', {'iface-id': '35491745-14cd-4e95-8217-6a0f6fc2bb55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:30:25', 'vm-uuid': '39653e2d-4446-4d30-a787-d16c9f5ca47f'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:54 user nova-compute[74892]: INFO os_vif [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:25,bridge_name='br-int',has_traffic_filtering=True,id=35491745-14cd-4e95-8217-6a0f6fc2bb55,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35491745-14')
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-99d8ad5d-5673-4b79-8c6f-f6afd080800d req-11a2d197-f3d4-41ef-a5c0-071a58c9e3cc service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Updated VIF entry in instance network info cache for port 35491745-14cd-4e95-8217-6a0f6fc2bb55. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-99d8ad5d-5673-4b79-8c6f-f6afd080800d req-11a2d197-f3d4-41ef-a5c0-071a58c9e3cc service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Updating instance_info_cache with network_info: [{"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-99d8ad5d-5673-4b79-8c6f-f6afd080800d req-11a2d197-f3d4-41ef-a5c0-071a58c9e3cc service nova] Releasing lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:23:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No VIF found with MAC fa:16:3e:ea:30:25, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:23:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Snapshot image upload complete
Nov 15 14:23:55 user nova-compute[74892]: INFO nova.compute.manager [None req-0194dd4e-0d6b-4b26-b3f2-3f72ebedfb18 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Took 7.19 seconds to snapshot the instance on the hypervisor.
Nov 15 14:23:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-277b436f-d6d0-4509-bab7-99be077e4a7f req-d1b139d5-734b-45b6-97f4-265b513be089 service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received event network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-277b436f-d6d0-4509-bab7-99be077e4a7f req-d1b139d5-734b-45b6-97f4-265b513be089 service nova] Acquiring lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-277b436f-d6d0-4509-bab7-99be077e4a7f req-d1b139d5-734b-45b6-97f4-265b513be089 service nova] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-277b436f-d6d0-4509-bab7-99be077e4a7f req-d1b139d5-734b-45b6-97f4-265b513be089 service nova] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-277b436f-d6d0-4509-bab7-99be077e4a7f req-d1b139d5-734b-45b6-97f4-265b513be089 service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] No waiting events found dispatching network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:56 user nova-compute[74892]: WARNING nova.compute.manager [req-277b436f-d6d0-4509-bab7-99be077e4a7f req-d1b139d5-734b-45b6-97f4-265b513be089 service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received unexpected event network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 for instance with vm_state building and task_state spawning.
Nov 15 14:23:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:23:58 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Instance spawned successfully.
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:23:58 user nova-compute[74892]: INFO nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:23:58 user nova-compute[74892]: INFO nova.compute.manager [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Took 7.28 seconds to build instance.
Nov 15 14:23:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bbe967d4-037c-431e-b02a-e5bc6e88a94a tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.511s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-670e4c81-aa0a-4463-9bb1-e0fdfdbe30ac req-c591f7dc-9174-458a-b98b-9882b1d736ad service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received event network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-670e4c81-aa0a-4463-9bb1-e0fdfdbe30ac req-c591f7dc-9174-458a-b98b-9882b1d736ad service nova] Acquiring lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-670e4c81-aa0a-4463-9bb1-e0fdfdbe30ac req-c591f7dc-9174-458a-b98b-9882b1d736ad service nova] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-670e4c81-aa0a-4463-9bb1-e0fdfdbe30ac req-c591f7dc-9174-458a-b98b-9882b1d736ad service nova] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:23:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-670e4c81-aa0a-4463-9bb1-e0fdfdbe30ac req-c591f7dc-9174-458a-b98b-9882b1d736ad service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] No waiting events found dispatching network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:23:58 user nova-compute[74892]: WARNING nova.compute.manager [req-670e4c81-aa0a-4463-9bb1-e0fdfdbe30ac req-c591f7dc-9174-458a-b98b-9882b1d736ad service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received unexpected event network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 for instance with vm_state active and task_state None.
Nov 15 14:23:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:24:17 user nova-compute[74892]: INFO nova.compute.claims [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Claim successful on node user
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:17 user nova-compute[74892]: INFO nova.compute.manager [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Terminating instance
Nov 15 14:24:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:24:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.policy [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c3e99992fb747808166fdd03a2420ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05fc70face4045788f0a46bd4cc29867', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:24:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Creating image(s)
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Instance destroyed successfully.
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lazy-loading 'resources' on Instance uuid eb9a1c70-0015-4c2a-ae2e-4ec79b06b094 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:22:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-52777240',display_name='tempest-VolumesActionsTest-instance-52777240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-52777240',id=22,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a556e70db2546b99136e2e3c2e863fa',ramdisk_id='',reservation_id='r-n759sm8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1775831030',owner_user_name='tempest-VolumesActionsTest-1775831030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:22:29Z,user_data=None,user_id='fe8ee8649f3b48659762693b148066ec',uuid=eb9a1c70-0015-4c2a-ae2e-4ec79b06b094,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Converting VIF {"id": "ab76f511-3249-4943-9781-1d8945049430", "address": "fa:16:3e:4d:c4:95", "network": {"id": "5f705d5d-4ec3-461b-a462-4632c3a2763f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-906585131-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a556e70db2546b99136e2e3c2e863fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab76f511-32", "ovs_interfaceid": "ab76f511-3249-4943-9781-1d8945049430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c4:95,bridge_name='br-int',has_traffic_filtering=True,id=ab76f511-3249-4943-9781-1d8945049430,network=Network(5f705d5d-4ec3-461b-a462-4632c3a2763f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab76f511-32') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG os_vif [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c4:95,bridge_name='br-int',has_traffic_filtering=True,id=ab76f511-3249-4943-9781-1d8945049430,network=Network(5f705d5d-4ec3-461b-a462-4632c3a2763f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab76f511-32') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab76f511-32, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77ef182d-b480-46fe-94cd-e0455ed62475) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:18 user nova-compute[74892]: INFO os_vif [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:c4:95,bridge_name='br-int',has_traffic_filtering=True,id=ab76f511-3249-4943-9781-1d8945049430,network=Network(5f705d5d-4ec3-461b-a462-4632c3a2763f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab76f511-32')
Nov 15 14:24:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Deleting instance files /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094_del
Nov 15 14:24:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Deletion of /opt/stack/data/nova/instances/eb9a1c70-0015-4c2a-ae2e-4ec79b06b094_del complete
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:18 user nova-compute[74892]: INFO nova.compute.manager [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk 1073741824" returned: 0 in 0.050s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Cannot resize image /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Ensure instance console log exists: /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:19 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Took 0.71 seconds to deallocate network for instance.
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-9563a6f6-deb4-4d0d-8466-2a3ef9731aeb req-04e33205-8596-476d-b6d4-1cf732d0a126 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Received event network-vif-deleted-ab76f511-3249-4943-9781-1d8945049430 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:19 user nova-compute[74892]: INFO nova.compute.manager [req-9563a6f6-deb4-4d0d-8466-2a3ef9731aeb req-04e33205-8596-476d-b6d4-1cf732d0a126 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Neutron deleted interface ab76f511-3249-4943-9781-1d8945049430; detaching it from the instance and deleting it from the info cache
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-9563a6f6-deb4-4d0d-8466-2a3ef9731aeb req-04e33205-8596-476d-b6d4-1cf732d0a126 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Successfully created port: 995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-9563a6f6-deb4-4d0d-8466-2a3ef9731aeb req-04e33205-8596-476d-b6d4-1cf732d0a126 service nova] [instance: eb9a1c70-0015-4c2a-ae2e-4ec79b06b094] Detach interface failed, port_id=ab76f511-3249-4943-9781-1d8945049430, reason: Instance eb9a1c70-0015-4c2a-ae2e-4ec79b06b094 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:24:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:20 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Deleted allocations for instance eb9a1c70-0015-4c2a-ae2e-4ec79b06b094
Nov 15 14:24:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4d3e41f8-ffac-48a4-8974-6901ec3f7879 tempest-VolumesActionsTest-1775831030 tempest-VolumesActionsTest-1775831030-project-member] Lock "eb9a1c70-0015-4c2a-ae2e-4ec79b06b094" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Successfully updated port: 995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquired lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-d7a33abc-5779-43c7-9049-ef513951be48 req-ce9be4eb-e852-4910-b38e-52e8a75be746 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-changed-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-d7a33abc-5779-43c7-9049-ef513951be48 req-ce9be4eb-e852-4910-b38e-52e8a75be746 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Refreshing instance network info cache due to event network-changed-995f76ef-0e34-4c72-8c67-ff575231e6cf. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d7a33abc-5779-43c7-9049-ef513951be48 req-ce9be4eb-e852-4910-b38e-52e8a75be746 service nova] Acquiring lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:24:20 user nova-compute[74892]: INFO nova.compute.claims [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Claim successful on node user
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:24:21 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating instance_info_cache with network_info: [{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Releasing lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance network_info: |[{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d7a33abc-5779-43c7-9049-ef513951be48 req-ce9be4eb-e852-4910-b38e-52e8a75be746 service nova] Acquired lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.network.neutron [req-d7a33abc-5779-43c7-9049-ef513951be48 req-ce9be4eb-e852-4910-b38e-52e8a75be746 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Refreshing network info cache for port 995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Start _get_guest_xml network_info=[{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:24:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:24:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1209906851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1209906851',id=25,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYIp96BY4njafdkukW1AZeIh/xphqcEZg1lAcfMjYfkkeNZ2xpYDF6tQzcgcn1LtJYbFmWS2WoB3hKNiC+q/N5fNsJpFr6zwpF74auvR/YJYzlAtbH4nxeEJuGrMhGOJg==',key_name='tempest-keypair-1742187766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ey0qyk5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=5267e3dc-3c08-4046-836c-6ac540f0476d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.objects.instance [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'pci_devices' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:24:21 user nova-compute[74892]:   <uuid>5267e3dc-3c08-4046-836c-6ac540f0476d</uuid>
Nov 15 14:24:21 user nova-compute[74892]:   <name>instance-00000019</name>
Nov 15 14:24:21 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:24:21 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:24:21 user nova-compute[74892]:   <metadata>
Nov 15 14:24:21 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:24:21 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:24:21 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1209906851</nova:name>
Nov 15 14:24:21 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:24:21</nova:creationTime>
Nov 15 14:24:21 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:24:21 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:24:21 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:24:21 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:24:21 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:24:21 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:24:21 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:24:21 user nova-compute[74892]:       <nova:owner>
Nov 15 14:24:21 user nova-compute[74892]:         <nova:user uuid="0c3e99992fb747808166fdd03a2420ff">tempest-AttachVolumeShelveTestJSON-769417742-project-member</nova:user>
Nov 15 14:24:21 user nova-compute[74892]:         <nova:project uuid="05fc70face4045788f0a46bd4cc29867">tempest-AttachVolumeShelveTestJSON-769417742</nova:project>
Nov 15 14:24:21 user nova-compute[74892]:       </nova:owner>
Nov 15 14:24:21 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:24:21 user nova-compute[74892]:       <nova:ports>
Nov 15 14:24:21 user nova-compute[74892]:         <nova:port uuid="995f76ef-0e34-4c72-8c67-ff575231e6cf">
Nov 15 14:24:21 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:24:21 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:21 user nova-compute[74892]:       </nova:ports>
Nov 15 14:24:21 user nova-compute[74892]:     </nova:instance>
Nov 15 14:24:21 user nova-compute[74892]:   </metadata>
Nov 15 14:24:21 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:24:21 user nova-compute[74892]:     <system>
Nov 15 14:24:21 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:24:21 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:24:21 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:24:21 user nova-compute[74892]:       <entry name="serial">5267e3dc-3c08-4046-836c-6ac540f0476d</entry>
Nov 15 14:24:21 user nova-compute[74892]:       <entry name="uuid">5267e3dc-3c08-4046-836c-6ac540f0476d</entry>
Nov 15 14:24:21 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:24:21 user nova-compute[74892]:     </system>
Nov 15 14:24:21 user nova-compute[74892]:   </sysinfo>
Nov 15 14:24:21 user nova-compute[74892]:   <os>
Nov 15 14:24:21 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:24:21 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:24:21 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:24:21 user nova-compute[74892]:   </os>
Nov 15 14:24:21 user nova-compute[74892]:   <features>
Nov 15 14:24:21 user nova-compute[74892]:     <acpi/>
Nov 15 14:24:21 user nova-compute[74892]:     <apic/>
Nov 15 14:24:21 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:24:21 user nova-compute[74892]:   </features>
Nov 15 14:24:21 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:24:21 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:24:21 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:24:21 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:24:21 user nova-compute[74892]:   </clock>
Nov 15 14:24:21 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:24:21 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:24:21 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:24:21 user nova-compute[74892]:   </cpu>
Nov 15 14:24:21 user nova-compute[74892]:   <devices>
Nov 15 14:24:21 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:24:21 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:24:21 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk"/>
Nov 15 14:24:21 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:24:21 user nova-compute[74892]:     </disk>
Nov 15 14:24:21 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:21 user nova-compute[74892]:       <mac address="fa:16:3e:4a:3a:e4"/>
Nov 15 14:24:21 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:21 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:21 user nova-compute[74892]:       <target dev="tap995f76ef-0e"/>
Nov 15 14:24:21 user nova-compute[74892]:     </interface>
Nov 15 14:24:21 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:24:21 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/console.log" append="off"/>
Nov 15 14:24:21 user nova-compute[74892]:     </serial>
Nov 15 14:24:21 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:24:21 user nova-compute[74892]:     <video>
Nov 15 14:24:21 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:21 user nova-compute[74892]:     </video>
Nov 15 14:24:21 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:24:21 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:24:21 user nova-compute[74892]:     </rng>
Nov 15 14:24:21 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:24:21 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:24:21 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:24:21 user nova-compute[74892]:     </memballoon>
Nov 15 14:24:21 user nova-compute[74892]:   </devices>
Nov 15 14:24:21 user nova-compute[74892]: </domain>
Nov 15 14:24:21 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1209906851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1209906851',id=25,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYIp96BY4njafdkukW1AZeIh/xphqcEZg1lAcfMjYfkkeNZ2xpYDF6tQzcgcn1LtJYbFmWS2WoB3hKNiC+q/N5fNsJpFr6zwpF74auvR/YJYzlAtbH4nxeEJuGrMhGOJg==',key_name='tempest-keypair-1742187766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ey0qyk5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=5267e3dc-3c08-4046-836c-6ac540f0476d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG os_vif [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:21 user nova-compute[74892]: INFO nova.virt.block_device [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Booting with volume d89100c3-f947-4c40-b4ff-f67ace62960e at /dev/vda
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f70e2397-d568-56a0-bd26-43eaf658a5cf', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap995f76ef-0e, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap995f76ef-0e, col_values=(('qos', UUID('1f4cf553-3740-48c1-a74d-fa9d53720e45')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap995f76ef-0e, col_values=(('external_ids', {'iface-id': '995f76ef-0e34-4c72-8c67-ff575231e6cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:3a:e4', 'vm-uuid': '5267e3dc-3c08-4046-836c-6ac540f0476d'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:21 user nova-compute[74892]: INFO os_vif [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e')
Nov 15 14:24:21 user nova-compute[74892]: DEBUG os_brick.utils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.policy [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b194d77741c047219a9af6ae55979554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1f38c1463544149842279bfc867448', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bc325b-c1ab-424f-b070-0edcd3c5c69f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No VIF found with MAC fa:16:3e:4a:3a:e4, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b047755a-dfc0-4023-8ec3-993b4f5443eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e6ac7-e58e-4937-a852-43ec1109518e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe7e8d8-673d-4783-b4e5-800bc13eaf13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:24:21 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1acc83a-f3c3-4efb-a002-11276a405fef]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG os_brick.utils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating existing volume attachment record: ac447fa2-6297-4198-baff-5ec864c995e4 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:24:21 user nova-compute[74892]: INFO nova.compute.claims [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Claim successful on node user
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.network.neutron [req-d7a33abc-5779-43c7-9049-ef513951be48 req-ce9be4eb-e852-4910-b38e-52e8a75be746 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updated VIF entry in instance network info cache for port 995f76ef-0e34-4c72-8c67-ff575231e6cf. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.network.neutron [req-d7a33abc-5779-43c7-9049-ef513951be48 req-ce9be4eb-e852-4910-b38e-52e8a75be746 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating instance_info_cache with network_info: [{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d7a33abc-5779-43c7-9049-ef513951be48 req-ce9be4eb-e852-4910-b38e-52e8a75be746 service nova] Releasing lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.network.neutron [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:24:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.policy [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ceed2653a4d4f5bb746d404d3b6719c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ccd84f99ad45968290ce122b0a4416', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:24:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Creating image(s)
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "/opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "/opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "/opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully created port: 1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.204s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk 1073741824" returned: 0 in 0.078s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.222s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Successfully created port: 8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Cannot resize image /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Ensure instance console log exists: /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully created port: 0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully created port: 2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-da10fe31-ca0d-415e-8f3e-656a6d6df40e req-59d39a74-e1de-4bc1-9b8c-7b5d7e976e9e service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-da10fe31-ca0d-415e-8f3e-656a6d6df40e req-59d39a74-e1de-4bc1-9b8c-7b5d7e976e9e service nova] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-da10fe31-ca0d-415e-8f3e-656a6d6df40e req-59d39a74-e1de-4bc1-9b8c-7b5d7e976e9e service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-da10fe31-ca0d-415e-8f3e-656a6d6df40e req-59d39a74-e1de-4bc1-9b8c-7b5d7e976e9e service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-da10fe31-ca0d-415e-8f3e-656a6d6df40e req-59d39a74-e1de-4bc1-9b8c-7b5d7e976e9e service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] No waiting events found dispatching network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:24 user nova-compute[74892]: WARNING nova.compute.manager [req-da10fe31-ca0d-415e-8f3e-656a6d6df40e req-59d39a74-e1de-4bc1-9b8c-7b5d7e976e9e service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received unexpected event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf for instance with vm_state building and task_state spawning.
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Successfully updated port: 8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquired lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Updating instance_info_cache with network_info: [{"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Releasing lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Instance network_info: |[{"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Start _get_guest_xml network_info=[{"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:24:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:24:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-454557419',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-454557419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4545574',id=27,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtqEzjmSfLwBCV0N+k4p1l11876Y407Izp4fxQdG62eqz9T1i0bFkj4R4fgYF9D91kI5YQNew6VCfKpFQz/AAu707SGuR7r1QslsrbThWZp/fK1+ncJKfRxf8nTZXRBkw==',key_name='tempest-keypair-1798016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36ccd84f99ad45968290ce122b0a4416',ramdisk_id='',reservation_id='r-s9ggvtek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1401517509',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ceed2653a4d4f5bb746d404d3b6719c',uuid=cdc6d784-d785-48bf-8f3e-30422c4ef9d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Converting VIF {"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:62:46,bridge_name='br-int',has_traffic_filtering=True,id=8f1d081b-0a62-4834-9ed1-73cd8ee606da,network=Network(ffa83937-532d-450f-9713-b8e392cab267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1d081b-0a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.objects.instance [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lazy-loading 'pci_devices' on Instance uuid cdc6d784-d785-48bf-8f3e-30422c4ef9d3 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:24:24 user nova-compute[74892]:   <uuid>cdc6d784-d785-48bf-8f3e-30422c4ef9d3</uuid>
Nov 15 14:24:24 user nova-compute[74892]:   <name>instance-0000001b</name>
Nov 15 14:24:24 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:24:24 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:24:24 user nova-compute[74892]:   <metadata>
Nov 15 14:24:24 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:24:24 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:24:24 user nova-compute[74892]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-454557419</nova:name>
Nov 15 14:24:24 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:24:24</nova:creationTime>
Nov 15 14:24:24 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:24:24 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:24:24 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:24:24 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:24:24 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:24:24 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:24:24 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:24:24 user nova-compute[74892]:       <nova:owner>
Nov 15 14:24:24 user nova-compute[74892]:         <nova:user uuid="4ceed2653a4d4f5bb746d404d3b6719c">tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member</nova:user>
Nov 15 14:24:24 user nova-compute[74892]:         <nova:project uuid="36ccd84f99ad45968290ce122b0a4416">tempest-TestServerVolumeAttachScenarioOldVersion-1401517509</nova:project>
Nov 15 14:24:24 user nova-compute[74892]:       </nova:owner>
Nov 15 14:24:24 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:24:24 user nova-compute[74892]:       <nova:ports>
Nov 15 14:24:24 user nova-compute[74892]:         <nova:port uuid="8f1d081b-0a62-4834-9ed1-73cd8ee606da">
Nov 15 14:24:24 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:24:24 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:24 user nova-compute[74892]:       </nova:ports>
Nov 15 14:24:24 user nova-compute[74892]:     </nova:instance>
Nov 15 14:24:24 user nova-compute[74892]:   </metadata>
Nov 15 14:24:24 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:24:24 user nova-compute[74892]:     <system>
Nov 15 14:24:24 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:24:24 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:24:24 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:24:24 user nova-compute[74892]:       <entry name="serial">cdc6d784-d785-48bf-8f3e-30422c4ef9d3</entry>
Nov 15 14:24:24 user nova-compute[74892]:       <entry name="uuid">cdc6d784-d785-48bf-8f3e-30422c4ef9d3</entry>
Nov 15 14:24:24 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:24:24 user nova-compute[74892]:     </system>
Nov 15 14:24:24 user nova-compute[74892]:   </sysinfo>
Nov 15 14:24:24 user nova-compute[74892]:   <os>
Nov 15 14:24:24 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:24:24 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:24:24 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:24:24 user nova-compute[74892]:   </os>
Nov 15 14:24:24 user nova-compute[74892]:   <features>
Nov 15 14:24:24 user nova-compute[74892]:     <acpi/>
Nov 15 14:24:24 user nova-compute[74892]:     <apic/>
Nov 15 14:24:24 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:24:24 user nova-compute[74892]:   </features>
Nov 15 14:24:24 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:24:24 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:24:24 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:24:24 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:24:24 user nova-compute[74892]:   </clock>
Nov 15 14:24:24 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:24:24 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:24:24 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:24:24 user nova-compute[74892]:   </cpu>
Nov 15 14:24:24 user nova-compute[74892]:   <devices>
Nov 15 14:24:24 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:24:24 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:24:24 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk"/>
Nov 15 14:24:24 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:24:24 user nova-compute[74892]:     </disk>
Nov 15 14:24:24 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:24 user nova-compute[74892]:       <mac address="fa:16:3e:c7:62:46"/>
Nov 15 14:24:24 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:24 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:24 user nova-compute[74892]:       <target dev="tap8f1d081b-0a"/>
Nov 15 14:24:24 user nova-compute[74892]:     </interface>
Nov 15 14:24:24 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:24:24 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/console.log" append="off"/>
Nov 15 14:24:24 user nova-compute[74892]:     </serial>
Nov 15 14:24:24 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:24:24 user nova-compute[74892]:     <video>
Nov 15 14:24:24 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:24 user nova-compute[74892]:     </video>
Nov 15 14:24:24 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:24:24 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:24:24 user nova-compute[74892]:     </rng>
Nov 15 14:24:24 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:24:24 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:24:24 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:24:24 user nova-compute[74892]:     </memballoon>
Nov 15 14:24:24 user nova-compute[74892]:   </devices>
Nov 15 14:24:24 user nova-compute[74892]: </domain>
Nov 15 14:24:24 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-454557419',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-454557419',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4545574',id=27,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtqEzjmSfLwBCV0N+k4p1l11876Y407Izp4fxQdG62eqz9T1i0bFkj4R4fgYF9D91kI5YQNew6VCfKpFQz/AAu707SGuR7r1QslsrbThWZp/fK1+ncJKfRxf8nTZXRBkw==',key_name='tempest-keypair-1798016923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36ccd84f99ad45968290ce122b0a4416',ramdisk_id='',reservation_id='r-s9ggvtek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1401517509',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ceed2653a4d4f5bb746d404d3b6719c',uuid=cdc6d784-d785-48bf-8f3e-30422c4ef9d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Converting VIF {"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:62:46,bridge_name='br-int',has_traffic_filtering=True,id=8f1d081b-0a62-4834-9ed1-73cd8ee606da,network=Network(ffa83937-532d-450f-9713-b8e392cab267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1d081b-0a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG os_vif [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:62:46,bridge_name='br-int',has_traffic_filtering=True,id=8f1d081b-0a62-4834-9ed1-73cd8ee606da,network=Network(ffa83937-532d-450f-9713-b8e392cab267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1d081b-0a') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10c737b4-9a09-54dd-986b-6681c4eea8e8', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f1d081b-0a, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f1d081b-0a, col_values=(('qos', UUID('fd21eaf6-c6f0-44c9-9b86-394e76cbe19a')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f1d081b-0a, col_values=(('external_ids', {'iface-id': '8f1d081b-0a62-4834-9ed1-73cd8ee606da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:62:46', 'vm-uuid': 'cdc6d784-d785-48bf-8f3e-30422c4ef9d3'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:25 user nova-compute[74892]: INFO os_vif [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:62:46,bridge_name='br-int',has_traffic_filtering=True,id=8f1d081b-0a62-4834-9ed1-73cd8ee606da,network=Network(ffa83937-532d-450f-9713-b8e392cab267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1d081b-0a')
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] No VIF found with MAC fa:16:3e:c7:62:46, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully created port: 24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:24:25 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance spawned successfully.
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:25 user nova-compute[74892]: INFO nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Took 7.07 seconds to spawn the instance on the hypervisor.
Nov 15 14:24:25 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:24:25 user nova-compute[74892]: INFO nova.compute.manager [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Took 8.04 seconds to build instance.
Nov 15 14:24:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6d19b7f3-dfbb-49c1-9a5a-445bdeecfc6b tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.171s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully created port: 41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received event network-changed-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Refreshing instance network info cache due to event network-changed-8f1d081b-0a62-4834-9ed1-73cd8ee606da. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] Acquiring lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] Acquired lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.network.neutron [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Refreshing network info cache for port 8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully updated port: 1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.network.neutron [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Updated VIF entry in instance network info cache for port 8f1d081b-0a62-4834-9ed1-73cd8ee606da. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.network.neutron [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Updating instance_info_cache with network_info: [{"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] Releasing lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] No waiting events found dispatching network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:26 user nova-compute[74892]: WARNING nova.compute.manager [req-8813be24-7679-42ae-98db-8b476c75035f req-cc13bac3-a0ab-41a4-be98-aa9f1c6973f7 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received unexpected event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf for instance with vm_state active and task_state None.
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-6436c069-0a83-4c7f-bd65-3b35ec07442a req-d7ebe917-cb55-45b5-8389-deff315fd190 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-changed-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-6436c069-0a83-4c7f-bd65-3b35ec07442a req-d7ebe917-cb55-45b5-8389-deff315fd190 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing instance network info cache due to event network-changed-1db44052-9866-4228-b68c-71236be24436. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6436c069-0a83-4c7f-bd65-3b35ec07442a req-d7ebe917-cb55-45b5-8389-deff315fd190 service nova] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6436c069-0a83-4c7f-bd65-3b35ec07442a req-d7ebe917-cb55-45b5-8389-deff315fd190 service nova] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:26 user nova-compute[74892]: DEBUG nova.network.neutron [req-6436c069-0a83-4c7f-bd65-3b35ec07442a req-d7ebe917-cb55-45b5-8389-deff315fd190 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing network info cache for port 1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG nova.network.neutron [req-6436c069-0a83-4c7f-bd65-3b35ec07442a req-d7ebe917-cb55-45b5-8389-deff315fd190 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG nova.network.neutron [req-6436c069-0a83-4c7f-bd65-3b35ec07442a req-d7ebe917-cb55-45b5-8389-deff315fd190 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6436c069-0a83-4c7f-bd65-3b35ec07442a req-d7ebe917-cb55-45b5-8389-deff315fd190 service nova] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:27 user nova-compute[74892]: INFO nova.virt.block_device [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Booting with volume 07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb at /dev/vdb
Nov 15 14:24:27 user nova-compute[74892]: DEBUG os_brick.utils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[de07ef57-da78-4107-8fdc-d0a3c370b2ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[09175ed3-6eb5-44b5-87e7-3d304bdd4b15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b7833d-ce81-40da-9cd6-82c823630afd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f844d-3b72-4eff-b8ae-d0d84e5a63d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:24:27 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:24:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[db057189-fdf4-4081-bf97-d2b1e16a0042]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG os_brick.utils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating existing volume attachment record: 64c6d9a8-8e19-470d-8960-136fa7027fd3 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:24:27 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully updated port: 03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-df3fd2d7-e53e-4cf1-bce3-d2286f1d0bed req-259ad130-fc39-4503-93a9-0ab2c1534fbf service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-changed-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-df3fd2d7-e53e-4cf1-bce3-d2286f1d0bed req-259ad130-fc39-4503-93a9-0ab2c1534fbf service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing instance network info cache due to event network-changed-03b5d706-f9ed-4605-95dd-fa93deaa2742. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-df3fd2d7-e53e-4cf1-bce3-d2286f1d0bed req-259ad130-fc39-4503-93a9-0ab2c1534fbf service nova] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-df3fd2d7-e53e-4cf1-bce3-d2286f1d0bed req-259ad130-fc39-4503-93a9-0ab2c1534fbf service nova] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:28 user nova-compute[74892]: DEBUG nova.network.neutron [req-df3fd2d7-e53e-4cf1-bce3-d2286f1d0bed req-259ad130-fc39-4503-93a9-0ab2c1534fbf service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing network info cache for port 03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:28 user nova-compute[74892]: DEBUG nova.network.neutron [req-df3fd2d7-e53e-4cf1-bce3-d2286f1d0bed req-259ad130-fc39-4503-93a9-0ab2c1534fbf service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:24:28 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully updated port: 78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:28 user nova-compute[74892]: DEBUG nova.network.neutron [req-df3fd2d7-e53e-4cf1-bce3-d2286f1d0bed req-259ad130-fc39-4503-93a9-0ab2c1534fbf service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-df3fd2d7-e53e-4cf1-bce3-d2286f1d0bed req-259ad130-fc39-4503-93a9-0ab2c1534fbf service nova] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received event network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] No waiting events found dispatching network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:29 user nova-compute[74892]: WARNING nova.compute.manager [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received unexpected event network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da for instance with vm_state building and task_state spawning.
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received event network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] No waiting events found dispatching network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:29 user nova-compute[74892]: WARNING nova.compute.manager [req-17506731-4ab8-4aca-8bba-aa41bc21333f req-c053dcde-4ef8-4013-af1d-316dad1a0968 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received unexpected event network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da for instance with vm_state building and task_state spawning.
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:24:29 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Instance spawned successfully.
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:29 user nova-compute[74892]: INFO nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Took 6.84 seconds to spawn the instance on the hypervisor.
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully updated port: 0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:29 user nova-compute[74892]: INFO nova.compute.manager [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Took 7.87 seconds to build instance.
Nov 15 14:24:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-503b950d-440b-4159-a476-40131ea72e3f tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.991s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:30 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully updated port: 2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-changed-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing instance network info cache due to event network-changed-78f7e8d5-667d-4399-a36a-b1eeac685846. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:30 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing network info cache for port 78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:30 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-changed-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing instance network info cache due to event network-changed-0d10b0f5-952a-4549-8896-67427a234ad1. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing network info cache for port 0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully updated port: 24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-changed-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing instance network info cache due to event network-changed-2d458620-2125-4585-b59d-eb87c8d853dd. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing network info cache for port 2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3be94ae-28b2-41f0-802f-a27147a391f7 req-1b9319a0-90cf-4324-bfb5-67a2b78e3b2a service nova] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Successfully updated port: 41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:24:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:24:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:24:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-changed-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing instance network info cache due to event network-changed-24be016a-8d51-4687-9a52-78be7a2d537e. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:34 user nova-compute[74892]: INFO nova.virt.block_device [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Booting with volume 631854af-36c0-4c2b-a8a0-1d1bf07dda89 at /dev/vdc
Nov 15 14:24:34 user nova-compute[74892]: DEBUG os_brick.utils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c48d0ff-7399-438f-b2be-d0587a70d23e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c65a13-9521-4098-92ed-d43efaceb6be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c052f1a6-1405-42d0-81fe-c82f39a46ea5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[71da0e07-5cf8-4389-87db-65b465342063]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:24:34 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca74f635-f81c-4e3d-a5e0-446da3e15c00]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG os_brick.utils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating existing volume attachment record: 43bdb3e4-960e-4aac-aa6d-b529d0ba5f03 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG nova.network.neutron [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [{"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance network_info: |[{"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing network info cache for port 24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG nova.network.neutron [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updated VIF entry in instance network info cache for port 24be016a-8d51-4687-9a52-78be7a2d537e. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG nova.network.neutron [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [{"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-changed-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing instance network info cache due to event network-changed-41c90e2a-e9df-4f39-9d69-7409bfbfefdf. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG nova.network.neutron [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing network info cache for port 41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG nova.network.neutron [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updated VIF entry in instance network info cache for port 41c90e2a-e9df-4f39-9d69-7409bfbfefdf. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG nova.network.neutron [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [{"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-485e790b-de2f-4673-9120-33da4a85720c req-a80b4367-e992-427b-a369-428414273669 service nova] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:38 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:24:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:24:39 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Creating image(s)
Nov 15 14:24:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Ensure instance console log exists: /opt/stack/data/nova/instances/1737a0c1-61e0-44ff-b172-90b9e758781b/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Start _get_guest_xml network_info=[{"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPXUNDuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1737a0c1-61e0-44ff-b172-90b9e758781b', 'attached_at': '', 'detached_at': '', 'volume_id': 'd89100c3-f947-4c40-b4ff-f67ace62960e', 'serial': 'd89100c3-f947-4c40-b4ff-f67ace62960e'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'ac447fa2-6297-4198-baff-5ec864c995e4', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBbnWhRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1737a0c1-61e0-44ff-b172-90b9e758781b', 'attached_at': '', 'detached_at': '', 'volume_id': '07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb', 'serial': '07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb'}, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '64c6d9a8-8e19-470d-8960-136fa7027fd3', 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWLVdhva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1737a0c1-61e0-44ff-b172-90b9e758781b', 'attached_at': '', 'detached_at': '', 'volume_id': '631854af-36c0-4c2b-a8a0-1d1bf07dda89', 'serial': '631854af-36c0-4c2b-a8a0-1d1bf07dda89'}, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '43bdb3e4-960e-4aac-aa6d-b529d0ba5f03', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:24:39 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:24:40 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:24:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPXUNDuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:24:40 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:24:40 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:24:40 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd139f-7f5f-48db-9b1d-430b4620b15a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:24:40 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bdeed7-5200-4c94-ba71-c4d60910d0b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e] added
Nov 15 14:24:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.079s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba4733d-9b59-41dd-bb0a-19afcda46a08]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[89258b7a-289f-460a-97f5-93e1bc0a199a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPXUNDuF {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RPXUNDuF" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0366a96-6aaa-443a-93c5-b2160da67abc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RPXUNDuF'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d808b5-7ab5-4c04-9d65-c80c1ff1e833]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e83727-8cd2-48bd-a804-f5cfebb450b7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[795420de-d7b4-4d29-b8c3-cf70698c454f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e, portal: 172.16.0.220,3260]
Nov 15 14:24:40 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e, portal: 172.16.0.220,3260] successful.
Nov 15 14:24:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb6ba34-e282-45b3-95fd-4b0a2c0bbed2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8bee2d-c980-46f8-a85e-f2fa0547587d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:40 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.495s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9fb9f0-bbaf-4161-95a0-46f5a8f60653]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPXUNDuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.539s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== connect_volume: return (1541ms) {'type': 'block', 'scsi_wwn': '26565613062633330', 'path': '/dev/sdg'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565613062633330', 'path': '/dev/sdg'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBbnWhRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:24:41 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:24:41 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:24:41 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fc498d-60f5-4700-aec8-73711f1e945e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:24:41 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2700d7a-859e-4429-9592-b80b56cd1e8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb] added
Nov 15 14:24:41 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fda501d-4499-4e8c-acbe-8995d86b2c69]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8a6dae-26fa-4850-a9e4-1700195d2a19]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBbnWhRu {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBbnWhRu" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1aa39c-175e-46c8-83f6-91cde60014a0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cBbnWhRu'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7529b1-88ff-4440-b31f-b74bb74dc3f2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc840982-510c-410f-a502-b364ae513fde]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:41 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:41 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5c71c0-a50d-4f57-81f7-b18d16fd128b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb, portal: 172.16.0.220,3260]
Nov 15 14:24:41 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb, portal: 172.16.0.220,3260] successful.
Nov 15 14:24:41 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c0a1c1-d604-489c-a561-29ae4cf8ffd5]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[48acb1d0-b97a-41ec-9509-f208fbe81944]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:24:41 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:41 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:24:41 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] HCTL ('39', '-', '-', 0) found on session 27 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:24:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3177726-092f-4243-b3f6-240b8c9405c8]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Searching for a device in session 27 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBbnWhRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23931343433363932', 'path': '/dev/sdh'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931343433363932', 'path': '/dev/sdh'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWLVdhva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:24:43 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:24:43 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:24:43 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54b58e9-f616-4859-9ebf-cb740dca26ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:24:43 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bf8bcf-9cef-455c-af72-f1eba96eba9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89] added
Nov 15 14:24:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8eb6ab-d137-473a-9bc8-2726f52aa25e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd90ee19-6ec4-4635-b3db-354dd1fb734f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWLVdhva {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RWLVdhva" returned: 0 in 0.048s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b42158-a4e7-4c67-8287-3f84668b9a2e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RWLVdhva'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cda6a9-93d5-4a07-8e17-624fc829ec4c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9857297c-8da5-4754-8aa1-3c2dafedc54e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:24:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:24:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf27353b-c918-4889-bbe1-d44430807de4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89, portal: 172.16.0.220,3260]
Nov 15 14:24:43 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89, portal: 172.16.0.220,3260] successful.
Nov 15 14:24:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c56edd0-10e9-418c-a33f-2081a91d3358]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:24:43 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7217MB free_disk=25.13495635986328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00f4c21-e231-4197-9734-f7af84d31a75]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:24:43 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:24:43 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.750s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] HCTL ('40', '-', '-', 0) found on session 28 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c84b5-8411-456b-8590-97efe056d81e]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Searching for a device in session 28 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWLVdhva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 726e0f64-5808-4e5b-accf-190ed1537b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d013f581-2c2a-4935-98d5-53b0904118ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9e258725-b58a-46c8-a2f0-099e246564a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ae627049-158a-4e50-9e9b-29fc7992345d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 39653e2d-4446-4d30-a787-d16c9f5ca47f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 5267e3dc-3c08-4046-836c-6ac540f0476d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1737a0c1-61e0-44ff-b172-90b9e758781b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:24:43 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.787s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== connect_volume: return (1788ms) {'type': 'block', 'scsi_wwn': '23966313063616531', 'path': '/dev/sdi'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966313063616531', 'path': '/dev/sdi'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:00:2c,bridge_name='br-int',has_traffic_filtering=True,id=1db44052-9866-4228-b68c-71236be24436,network=Network(fef43699-f31e-40e8-b3fe-26b0082d6662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db44052-98') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:d8,bridge_name='br-int',has_traffic_filtering=True,id=03b5d706-f9ed-4605-95dd-fa93deaa2742,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03b5d706-f9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:69:92,bridge_name='br-int',has_traffic_filtering=True,id=78f7e8d5-667d-4399-a36a-b1eeac685846,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78f7e8d5-66') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a6:42,bridge_name='br-int',has_traffic_filtering=True,id=0d10b0f5-952a-4549-8896-67427a234ad1,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d10b0f5-95') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=2d458620-2125-4585-b59d-eb87c8d853dd,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d458620-21') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=24be016a-8d51-4687-9a52-78be7a2d537e,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be016a-8d') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:05:73,bridge_name='br-int',has_traffic_filtering=True,id=41c90e2a-e9df-4f39-9d69-7409bfbfefdf,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c90e2a-e9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.objects.instance [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lazy-loading 'pci_devices' on Instance uuid 1737a0c1-61e0-44ff-b172-90b9e758781b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:24:44 user nova-compute[74892]:   <uuid>1737a0c1-61e0-44ff-b172-90b9e758781b</uuid>
Nov 15 14:24:44 user nova-compute[74892]:   <name>instance-0000001a</name>
Nov 15 14:24:44 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:24:44 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:24:44 user nova-compute[74892]:   <metadata>
Nov 15 14:24:44 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:24:44 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:24:44 user nova-compute[74892]:       <nova:name>tempest-device-tagging-server-1352376590</nova:name>
Nov 15 14:24:44 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:24:40</nova:creationTime>
Nov 15 14:24:44 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:24:44 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:24:44 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:24:44 user nova-compute[74892]:       <nova:owner>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:user uuid="b194d77741c047219a9af6ae55979554">tempest-TaggedBootDevicesTest-446006916-project-member</nova:user>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:project uuid="ac1f38c1463544149842279bfc867448">tempest-TaggedBootDevicesTest-446006916</nova:project>
Nov 15 14:24:44 user nova-compute[74892]:       </nova:owner>
Nov 15 14:24:44 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:24:44 user nova-compute[74892]:       <nova:ports>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:port uuid="1db44052-9866-4228-b68c-71236be24436">
Nov 15 14:24:44 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:24:44 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:port uuid="03b5d706-f9ed-4605-95dd-fa93deaa2742">
Nov 15 14:24:44 user nova-compute[74892]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Nov 15 14:24:44 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:port uuid="78f7e8d5-667d-4399-a36a-b1eeac685846">
Nov 15 14:24:44 user nova-compute[74892]:           <nova:ip type="fixed" address="10.1.1.170" ipVersion="4"/>
Nov 15 14:24:44 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:port uuid="0d10b0f5-952a-4549-8896-67427a234ad1">
Nov 15 14:24:44 user nova-compute[74892]:           <nova:ip type="fixed" address="10.1.1.92" ipVersion="4"/>
Nov 15 14:24:44 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:port uuid="2d458620-2125-4585-b59d-eb87c8d853dd">
Nov 15 14:24:44 user nova-compute[74892]:           <nova:ip type="fixed" address="10.1.1.176" ipVersion="4"/>
Nov 15 14:24:44 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:port uuid="24be016a-8d51-4687-9a52-78be7a2d537e">
Nov 15 14:24:44 user nova-compute[74892]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 14:24:44 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:44 user nova-compute[74892]:         <nova:port uuid="41c90e2a-e9df-4f39-9d69-7409bfbfefdf">
Nov 15 14:24:44 user nova-compute[74892]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 14:24:44 user nova-compute[74892]:         </nova:port>
Nov 15 14:24:44 user nova-compute[74892]:       </nova:ports>
Nov 15 14:24:44 user nova-compute[74892]:     </nova:instance>
Nov 15 14:24:44 user nova-compute[74892]:   </metadata>
Nov 15 14:24:44 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:24:44 user nova-compute[74892]:     <system>
Nov 15 14:24:44 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:24:44 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:24:44 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:24:44 user nova-compute[74892]:       <entry name="serial">1737a0c1-61e0-44ff-b172-90b9e758781b</entry>
Nov 15 14:24:44 user nova-compute[74892]:       <entry name="uuid">1737a0c1-61e0-44ff-b172-90b9e758781b</entry>
Nov 15 14:24:44 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:24:44 user nova-compute[74892]:     </system>
Nov 15 14:24:44 user nova-compute[74892]:   </sysinfo>
Nov 15 14:24:44 user nova-compute[74892]:   <os>
Nov 15 14:24:44 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:24:44 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:24:44 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:24:44 user nova-compute[74892]:   </os>
Nov 15 14:24:44 user nova-compute[74892]:   <features>
Nov 15 14:24:44 user nova-compute[74892]:     <acpi/>
Nov 15 14:24:44 user nova-compute[74892]:     <apic/>
Nov 15 14:24:44 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:24:44 user nova-compute[74892]:   </features>
Nov 15 14:24:44 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:24:44 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:24:44 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:24:44 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:24:44 user nova-compute[74892]:   </clock>
Nov 15 14:24:44 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:24:44 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:24:44 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:24:44 user nova-compute[74892]:   </cpu>
Nov 15 14:24:44 user nova-compute[74892]:   <devices>
Nov 15 14:24:44 user nova-compute[74892]:     <disk type="file" device="cdrom">
Nov 15 14:24:44 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 14:24:44 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/1737a0c1-61e0-44ff-b172-90b9e758781b/disk.config"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="hda" bus="ide"/>
Nov 15 14:24:44 user nova-compute[74892]:     </disk>
Nov 15 14:24:44 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:24:44 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:24:44 user nova-compute[74892]:       <source dev="/dev/sdg"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <serial>d89100c3-f947-4c40-b4ff-f67ace62960e</serial>
Nov 15 14:24:44 user nova-compute[74892]:     </disk>
Nov 15 14:24:44 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:24:44 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:24:44 user nova-compute[74892]:       <source dev="/dev/sdh"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <serial>07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb</serial>
Nov 15 14:24:44 user nova-compute[74892]:     </disk>
Nov 15 14:24:44 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:24:44 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:24:44 user nova-compute[74892]:       <source dev="/dev/sdi"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="vdc" bus="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <serial>631854af-36c0-4c2b-a8a0-1d1bf07dda89</serial>
Nov 15 14:24:44 user nova-compute[74892]:     </disk>
Nov 15 14:24:44 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:44 user nova-compute[74892]:       <mac address="fa:16:3e:f9:00:2c"/>
Nov 15 14:24:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="tap1db44052-98"/>
Nov 15 14:24:44 user nova-compute[74892]:     </interface>
Nov 15 14:24:44 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:44 user nova-compute[74892]:       <mac address="fa:16:3e:b3:2d:d8"/>
Nov 15 14:24:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="tap03b5d706-f9"/>
Nov 15 14:24:44 user nova-compute[74892]:     </interface>
Nov 15 14:24:44 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:44 user nova-compute[74892]:       <mac address="fa:16:3e:99:69:92"/>
Nov 15 14:24:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="tap78f7e8d5-66"/>
Nov 15 14:24:44 user nova-compute[74892]:     </interface>
Nov 15 14:24:44 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:44 user nova-compute[74892]:       <mac address="fa:16:3e:33:a6:42"/>
Nov 15 14:24:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="tap0d10b0f5-95"/>
Nov 15 14:24:44 user nova-compute[74892]:     </interface>
Nov 15 14:24:44 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:44 user nova-compute[74892]:       <mac address="fa:16:3e:b9:62:7d"/>
Nov 15 14:24:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="tap2d458620-21"/>
Nov 15 14:24:44 user nova-compute[74892]:     </interface>
Nov 15 14:24:44 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:44 user nova-compute[74892]:       <mac address="fa:16:3e:ef:6f:fc"/>
Nov 15 14:24:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="tap24be016a-8d"/>
Nov 15 14:24:44 user nova-compute[74892]:     </interface>
Nov 15 14:24:44 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:24:44 user nova-compute[74892]:       <mac address="fa:16:3e:89:05:73"/>
Nov 15 14:24:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:24:44 user nova-compute[74892]:       <target dev="tap41c90e2a-e9"/>
Nov 15 14:24:44 user nova-compute[74892]:     </interface>
Nov 15 14:24:44 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:24:44 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/1737a0c1-61e0-44ff-b172-90b9e758781b/console.log" append="off"/>
Nov 15 14:24:44 user nova-compute[74892]:     </serial>
Nov 15 14:24:44 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:24:44 user nova-compute[74892]:     <video>
Nov 15 14:24:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:24:44 user nova-compute[74892]:     </video>
Nov 15 14:24:44 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:24:44 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:24:44 user nova-compute[74892]:     </rng>
Nov 15 14:24:44 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:24:44 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:24:44 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:24:44 user nova-compute[74892]:     </memballoon>
Nov 15 14:24:44 user nova-compute[74892]:   </devices>
Nov 15 14:24:44 user nova-compute[74892]: </domain>
Nov 15 14:24:44 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:00:2c,bridge_name='br-int',has_traffic_filtering=True,id=1db44052-9866-4228-b68c-71236be24436,network=Network(fef43699-f31e-40e8-b3fe-26b0082d6662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db44052-98') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:00:2c,bridge_name='br-int',has_traffic_filtering=True,id=1db44052-9866-4228-b68c-71236be24436,network=Network(fef43699-f31e-40e8-b3fe-26b0082d6662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db44052-98') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25dfb82d-3a6f-56e3-813c-a5fb207e36fb', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1db44052-98, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1db44052-98, col_values=(('qos', UUID('95108005-35e7-4fee-857d-d2523e885b7f')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1db44052-98, col_values=(('external_ids', {'iface-id': '1db44052-9866-4228-b68c-71236be24436', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:00:2c', 'vm-uuid': '1737a0c1-61e0-44ff-b172-90b9e758781b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: INFO os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:00:2c,bridge_name='br-int',has_traffic_filtering=True,id=1db44052-9866-4228-b68c-71236be24436,network=Network(fef43699-f31e-40e8-b3fe-26b0082d6662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db44052-98')
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:d8,bridge_name='br-int',has_traffic_filtering=True,id=03b5d706-f9ed-4605-95dd-fa93deaa2742,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03b5d706-f9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:d8,bridge_name='br-int',has_traffic_filtering=True,id=03b5d706-f9ed-4605-95dd-fa93deaa2742,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03b5d706-f9') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1455f76e-6921-53c7-aa4f-05f241967904', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03b5d706-f9, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03b5d706-f9, col_values=(('qos', UUID('56b5423a-79fc-4a33-9bec-b8e0f5490037')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03b5d706-f9, col_values=(('external_ids', {'iface-id': '03b5d706-f9ed-4605-95dd-fa93deaa2742', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:2d:d8', 'vm-uuid': '1737a0c1-61e0-44ff-b172-90b9e758781b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: INFO os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:d8,bridge_name='br-int',has_traffic_filtering=True,id=03b5d706-f9ed-4605-95dd-fa93deaa2742,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03b5d706-f9')
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:69:92,bridge_name='br-int',has_traffic_filtering=True,id=78f7e8d5-667d-4399-a36a-b1eeac685846,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78f7e8d5-66') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:69:92,bridge_name='br-int',has_traffic_filtering=True,id=78f7e8d5-667d-4399-a36a-b1eeac685846,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78f7e8d5-66') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed98ba06-5759-52b3-8f4e-e8a5e9f779f4', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78f7e8d5-66, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78f7e8d5-66, col_values=(('qos', UUID('ed62f98f-c3bd-487a-93b2-0d4048564806')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78f7e8d5-66, col_values=(('external_ids', {'iface-id': '78f7e8d5-667d-4399-a36a-b1eeac685846', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:69:92', 'vm-uuid': '1737a0c1-61e0-44ff-b172-90b9e758781b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: INFO os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:69:92,bridge_name='br-int',has_traffic_filtering=True,id=78f7e8d5-667d-4399-a36a-b1eeac685846,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78f7e8d5-66')
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a6:42,bridge_name='br-int',has_traffic_filtering=True,id=0d10b0f5-952a-4549-8896-67427a234ad1,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d10b0f5-95') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a6:42,bridge_name='br-int',has_traffic_filtering=True,id=0d10b0f5-952a-4549-8896-67427a234ad1,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d10b0f5-95') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fcdee6d-261e-5da7-aea4-ca4b4760f134', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d10b0f5-95, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d10b0f5-95, col_values=(('qos', UUID('62ae9bfe-1c2d-4709-a844-b914b58f6c83')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d10b0f5-95, col_values=(('external_ids', {'iface-id': '0d10b0f5-952a-4549-8896-67427a234ad1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:a6:42', 'vm-uuid': '1737a0c1-61e0-44ff-b172-90b9e758781b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: INFO os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a6:42,bridge_name='br-int',has_traffic_filtering=True,id=0d10b0f5-952a-4549-8896-67427a234ad1,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d10b0f5-95')
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=2d458620-2125-4585-b59d-eb87c8d853dd,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d458620-21') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=2d458620-2125-4585-b59d-eb87c8d853dd,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d458620-21') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a643c0c3-5dfa-5fce-a8d3-d5e661719095', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d458620-21, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d458620-21, col_values=(('qos', UUID('58ac8d32-a332-4d7b-ab8b-59beac91c2ef')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d458620-21, col_values=(('external_ids', {'iface-id': '2d458620-2125-4585-b59d-eb87c8d853dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:62:7d', 'vm-uuid': '1737a0c1-61e0-44ff-b172-90b9e758781b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: INFO os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=2d458620-2125-4585-b59d-eb87c8d853dd,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d458620-21')
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=24be016a-8d51-4687-9a52-78be7a2d537e,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be016a-8d') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=24be016a-8d51-4687-9a52-78be7a2d537e,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be016a-8d') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60859aa4-5740-5927-9853-ccb2d965b1e2', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24be016a-8d, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24be016a-8d, col_values=(('qos', UUID('3339f15a-f56d-477e-9bb6-a44f80c255b5')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24be016a-8d, col_values=(('external_ids', {'iface-id': '24be016a-8d51-4687-9a52-78be7a2d537e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:6f:fc', 'vm-uuid': '1737a0c1-61e0-44ff-b172-90b9e758781b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: INFO os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=24be016a-8d51-4687-9a52-78be7a2d537e,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be016a-8d')
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:05:73,bridge_name='br-int',has_traffic_filtering=True,id=41c90e2a-e9df-4f39-9d69-7409bfbfefdf,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c90e2a-e9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:05:73,bridge_name='br-int',has_traffic_filtering=True,id=41c90e2a-e9df-4f39-9d69-7409bfbfefdf,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c90e2a-e9') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '825dc012-9034-56db-b415-d4c2c0b19698', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41c90e2a-e9, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41c90e2a-e9, col_values=(('qos', UUID('404012d5-4036-45b1-816f-fb971164676e')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41c90e2a-e9, col_values=(('external_ids', {'iface-id': '41c90e2a-e9df-4f39-9d69-7409bfbfefdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:05:73', 'vm-uuid': '1737a0c1-61e0-44ff-b172-90b9e758781b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:45 user nova-compute[74892]: INFO os_vif [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:05:73,bridge_name='br-int',has_traffic_filtering=True,id=41c90e2a-e9df-4f39-9d69-7409bfbfefdf,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c90e2a-e9')
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] No BDM found with device name hda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] No VIF found with MAC fa:16:3e:f9:00:2c, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] No VIF found with MAC fa:16:3e:b9:62:7d, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:24:45 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Using config drive
Nov 15 14:24:45 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Creating config drive at /opt/stack/data/nova/instances/1737a0c1-61e0-44ff-b172-90b9e758781b/disk.config
Nov 15 14:24:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1737a0c1-61e0-44ff-b172-90b9e758781b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd6ytmw_z {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:24:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1737a0c1-61e0-44ff-b172-90b9e758781b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd6ytmw_z" returned: 0 in 0.081s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:24:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-b17faa86-52cb-4b0c-8356-f2339738340b req-230092a5-2a1f-4ec6-a7ae-6e6c885a9552 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b17faa86-52cb-4b0c-8356-f2339738340b req-230092a5-2a1f-4ec6-a7ae-6e6c885a9552 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b17faa86-52cb-4b0c-8356-f2339738340b req-230092a5-2a1f-4ec6-a7ae-6e6c885a9552 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b17faa86-52cb-4b0c-8356-f2339738340b req-230092a5-2a1f-4ec6-a7ae-6e6c885a9552 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-b17faa86-52cb-4b0c-8356-f2339738340b req-230092a5-2a1f-4ec6-a7ae-6e6c885a9552 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:47 user nova-compute[74892]: WARNING nova.compute.manager [req-b17faa86-52cb-4b0c-8356-f2339738340b req-230092a5-2a1f-4ec6-a7ae-6e6c885a9552 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 for instance with vm_state building and task_state spawning.
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-eb4dfc77-c5a9-4fe8-a3ee-69255d22cf88 req-3e834424-ed11-41bf-96c4-4e1ddc515e46 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb4dfc77-c5a9-4fe8-a3ee-69255d22cf88 req-3e834424-ed11-41bf-96c4-4e1ddc515e46 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb4dfc77-c5a9-4fe8-a3ee-69255d22cf88 req-3e834424-ed11-41bf-96c4-4e1ddc515e46 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb4dfc77-c5a9-4fe8-a3ee-69255d22cf88 req-3e834424-ed11-41bf-96c4-4e1ddc515e46 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-eb4dfc77-c5a9-4fe8-a3ee-69255d22cf88 req-3e834424-ed11-41bf-96c4-4e1ddc515e46 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:47 user nova-compute[74892]: WARNING nova.compute.manager [req-eb4dfc77-c5a9-4fe8-a3ee-69255d22cf88 req-3e834424-ed11-41bf-96c4-4e1ddc515e46 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 for instance with vm_state building and task_state spawning.
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-507f6703-ecbf-40c4-b28d-692f11b64922 req-2e966da6-d654-407e-93bb-185178b4a5dd service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-507f6703-ecbf-40c4-b28d-692f11b64922 req-2e966da6-d654-407e-93bb-185178b4a5dd service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-507f6703-ecbf-40c4-b28d-692f11b64922 req-2e966da6-d654-407e-93bb-185178b4a5dd service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-507f6703-ecbf-40c4-b28d-692f11b64922 req-2e966da6-d654-407e-93bb-185178b4a5dd service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-507f6703-ecbf-40c4-b28d-692f11b64922 req-2e966da6-d654-407e-93bb-185178b4a5dd service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:48 user nova-compute[74892]: WARNING nova.compute.manager [req-507f6703-ecbf-40c4-b28d-692f11b64922 req-2e966da6-d654-407e-93bb-185178b4a5dd service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 for instance with vm_state building and task_state spawning.
Nov 15 14:24:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updating instance_info_cache with network_info: [{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:49 user nova-compute[74892]: WARNING nova.compute.manager [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 for instance with vm_state building and task_state spawning.
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:49 user nova-compute[74892]: WARNING nova.compute.manager [req-264b4aaf-c650-43df-8fe5-3bcd392f8139 req-b985ab64-404a-4c7d-9181-fa2adcf27f96 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf for instance with vm_state building and task_state spawning.
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:49 user nova-compute[74892]: WARNING nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 for instance with vm_state building and task_state spawning.
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:49 user nova-compute[74892]: WARNING nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd for instance with vm_state building and task_state spawning.
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:49 user nova-compute[74892]: WARNING nova.compute.manager [req-36db0edf-d273-4eab-bdf6-c7eb12b5e81e req-629e50df-e40e-4616-a4c7-9f7acc60f844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd for instance with vm_state building and task_state spawning.
Nov 15 14:24:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:50 user nova-compute[74892]: WARNING nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 for instance with vm_state building and task_state spawning.
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:50 user nova-compute[74892]: WARNING nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 for instance with vm_state building and task_state spawning.
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:50 user nova-compute[74892]: WARNING nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 for instance with vm_state building and task_state spawning.
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:50 user nova-compute[74892]: WARNING nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e for instance with vm_state building and task_state spawning.
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:50 user nova-compute[74892]: WARNING nova.compute.manager [req-2feb6afe-6455-4db6-a114-0d918b9adcd0 req-15395165-7770-4ea3-8724-d7447f97703e service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e for instance with vm_state building and task_state spawning.
Nov 15 14:24:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:50 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:24:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance spawned successfully.
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:24:51 user nova-compute[74892]: INFO nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Took 11.80 seconds to spawn the instance on the hypervisor.
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-6c422f8e-1e41-4f3f-8825-89dfdd55b7b3 req-f0c437c8-ea3b-4cc9-b01b-842eb0430d8c service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6c422f8e-1e41-4f3f-8825-89dfdd55b7b3 req-f0c437c8-ea3b-4cc9-b01b-842eb0430d8c service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6c422f8e-1e41-4f3f-8825-89dfdd55b7b3 req-f0c437c8-ea3b-4cc9-b01b-842eb0430d8c service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6c422f8e-1e41-4f3f-8825-89dfdd55b7b3 req-f0c437c8-ea3b-4cc9-b01b-842eb0430d8c service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-6c422f8e-1e41-4f3f-8825-89dfdd55b7b3 req-f0c437c8-ea3b-4cc9-b01b-842eb0430d8c service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:24:51 user nova-compute[74892]: WARNING nova.compute.manager [req-6c422f8e-1e41-4f3f-8825-89dfdd55b7b3 req-f0c437c8-ea3b-4cc9-b01b-842eb0430d8c service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf for instance with vm_state building and task_state spawning.
Nov 15 14:24:51 user nova-compute[74892]: INFO nova.compute.manager [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Took 31.14 seconds to build instance.
Nov 15 14:24:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-23661863-118a-4732-9f39-0ae1f89eb8b8 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.244s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:24:53 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:24:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:24:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.objects.instance [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquired lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.objects.instance [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'info_cache' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.objects.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating instance_info_cache with network_info: [{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Releasing lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:25:00 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance destroyed successfully.
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.objects.instance [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'resources' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.objects.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_vif [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap904d19af-08, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9ae739c-e577-4318-a12f-1c46cd1e735a) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:00 user nova-compute[74892]: INFO os_vif [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08')
Nov 15 14:25:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqyLdAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:00 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc56576-6fee-49ab-b0a3-ab622fc8ef46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:25:00 user nova-compute[74892]: No targets found.
Nov 15 14:25:00 user nova-compute[74892]: iSNS:
Nov 15 14:25:00 user nova-compute[74892]: No targets found.
Nov 15 14:25:00 user nova-compute[74892]: STATIC:
Nov 15 14:25:00 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:25:00 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:00 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:00 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc
Nov 15 14:25:00 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:00 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:00 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e
Nov 15 14:25:00 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:00 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:00 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:25:00 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:00 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:00 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8
Nov 15 14:25:00 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:00 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:00 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89
Nov 15 14:25:00 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:00 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:00 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:25:00 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:00 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:00 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb
Nov 15 14:25:00 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:00 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:00 user nova-compute[74892]: FIRMWARE:
Nov 15 14:25:00 user nova-compute[74892]: No targets found.
Nov 15 14:25:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:25:00 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:25:00 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed3c400-2fe1-4c90-828e-6488faf020f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7e33b6-b7dc-40f1-8552-59919c215565]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:00 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00629360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b8263-67bd-4d64-987a-efdcc65747f8]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d32a3-fee8-4124-8b8b-7b45c15098df]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[490d31c5-e382-403e-869a-f2a4e705058f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b469f731-8190-4c22-9f76-e04f2c9978e8]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[73720c89-1979-40eb-b2b4-8aaa7c641dfb]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd4b142-f067-4fdd-b474-ea2918a4fa8d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260]
Nov 15 14:25:01 user nova-compute[74892]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260] successful.
Nov 15 14:25:01 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[611914aa-e0a4-42cd-ad6c-3c917b4d4aa8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== disconnect_volume: return (364ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Start _get_guest_xml network_info=[{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqyLdAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '45201330-05c4-4109-99c2-d17761f46add', 'attached_at': '', 'detached_at': '', 'volume_id': '817f9b79-ad7a-40e2-bcde-9be2b56ae109', 'serial': '817f9b79-ad7a-40e2-bcde-9be2b56ae109'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '337aef95-f99f-44c0-a7f0-58f05257b81f', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.objects.instance [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'numa_topology' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.objects.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:25:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.objects.instance [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'vcpu_model' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.objects.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqyLdAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:01 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:01 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:01 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f844d-fc1c-4f20-8627-9833c8a4e836]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:25:01 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75aefe8-d179-4d56-bab7-62f49bee140e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109] added
Nov 15 14:25:01 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f141988-1140-41d9-86e0-0cbd2e8e13d5]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ccffa6-aa3c-4988-800e-33d66488e7f8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtqyLdAI {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtqyLdAI" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfe296b-dc7a-4eb8-b66c-660902e3b516]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtqyLdAI'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[670efb3d-d9ba-4e9a-ae0e-193cb1ff225a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a2aa7a-76cd-44a1-8ed6-68d8bf9310e1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cb6d5a-f797-4bfe-9639-5eb888d7e236]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260]
Nov 15 14:25:01 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260] successful.
Nov 15 14:25:01 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[649bf312-7371-4921-8e3a-a691050c19b9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ad322f-822f-4144-b96f-05fa5ce89125]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:01 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9416ec8c-cb1f-465f-95dc-842647466b59]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:25:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqyLdAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23164373831373233', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164373831373233', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.objects.instance [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'pci_devices' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.objects.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:25:02 user nova-compute[74892]:   <uuid>45201330-05c4-4109-99c2-d17761f46add</uuid>
Nov 15 14:25:02 user nova-compute[74892]:   <name>instance-00000011</name>
Nov 15 14:25:02 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:25:02 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:25:02 user nova-compute[74892]:   <metadata>
Nov 15 14:25:02 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:25:02 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:25:02 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeTestJSON-server-423975802</nova:name>
Nov 15 14:25:02 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:25:01</nova:creationTime>
Nov 15 14:25:02 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:25:02 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:25:02 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:25:02 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:25:02 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:25:02 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:25:02 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:25:02 user nova-compute[74892]:       <nova:owner>
Nov 15 14:25:02 user nova-compute[74892]:         <nova:user uuid="1a85e0d65c2248e0aca031055b162e86">tempest-AttachVolumeTestJSON-1499270628-project-member</nova:user>
Nov 15 14:25:02 user nova-compute[74892]:         <nova:project uuid="5649287d611341a7850ed74e51b7bfe3">tempest-AttachVolumeTestJSON-1499270628</nova:project>
Nov 15 14:25:02 user nova-compute[74892]:       </nova:owner>
Nov 15 14:25:02 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:25:02 user nova-compute[74892]:       <nova:ports>
Nov 15 14:25:02 user nova-compute[74892]:         <nova:port uuid="904d19af-084f-43ac-8378-cf5b7e822961">
Nov 15 14:25:02 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:25:02 user nova-compute[74892]:         </nova:port>
Nov 15 14:25:02 user nova-compute[74892]:       </nova:ports>
Nov 15 14:25:02 user nova-compute[74892]:     </nova:instance>
Nov 15 14:25:02 user nova-compute[74892]:   </metadata>
Nov 15 14:25:02 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:25:02 user nova-compute[74892]:     <system>
Nov 15 14:25:02 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:25:02 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:25:02 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:25:02 user nova-compute[74892]:       <entry name="serial">45201330-05c4-4109-99c2-d17761f46add</entry>
Nov 15 14:25:02 user nova-compute[74892]:       <entry name="uuid">45201330-05c4-4109-99c2-d17761f46add</entry>
Nov 15 14:25:02 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:25:02 user nova-compute[74892]:     </system>
Nov 15 14:25:02 user nova-compute[74892]:   </sysinfo>
Nov 15 14:25:02 user nova-compute[74892]:   <os>
Nov 15 14:25:02 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:25:02 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:25:02 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:25:02 user nova-compute[74892]:   </os>
Nov 15 14:25:02 user nova-compute[74892]:   <features>
Nov 15 14:25:02 user nova-compute[74892]:     <acpi/>
Nov 15 14:25:02 user nova-compute[74892]:     <apic/>
Nov 15 14:25:02 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:25:02 user nova-compute[74892]:   </features>
Nov 15 14:25:02 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:25:02 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:25:02 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:25:02 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:25:02 user nova-compute[74892]:   </clock>
Nov 15 14:25:02 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:25:02 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:25:02 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:25:02 user nova-compute[74892]:   </cpu>
Nov 15 14:25:02 user nova-compute[74892]:   <devices>
Nov 15 14:25:02 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:25:02 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:25:02 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk"/>
Nov 15 14:25:02 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:25:02 user nova-compute[74892]:     </disk>
Nov 15 14:25:02 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:25:02 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:25:02 user nova-compute[74892]:       <source dev="/dev/sdc"/>
Nov 15 14:25:02 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:25:02 user nova-compute[74892]:       <serial>817f9b79-ad7a-40e2-bcde-9be2b56ae109</serial>
Nov 15 14:25:02 user nova-compute[74892]:     </disk>
Nov 15 14:25:02 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:25:02 user nova-compute[74892]:       <mac address="fa:16:3e:2f:62:55"/>
Nov 15 14:25:02 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:25:02 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:25:02 user nova-compute[74892]:       <target dev="tap904d19af-08"/>
Nov 15 14:25:02 user nova-compute[74892]:     </interface>
Nov 15 14:25:02 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:25:02 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/console.log" append="off"/>
Nov 15 14:25:02 user nova-compute[74892]:     </serial>
Nov 15 14:25:02 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:25:02 user nova-compute[74892]:     <video>
Nov 15 14:25:02 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:25:02 user nova-compute[74892]:     </video>
Nov 15 14:25:02 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:25:02 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:25:02 user nova-compute[74892]:     </rng>
Nov 15 14:25:02 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:25:02 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:25:02 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:25:02 user nova-compute[74892]:     </memballoon>
Nov 15 14:25:02 user nova-compute[74892]:   </devices>
Nov 15 14:25:02 user nova-compute[74892]: </domain>
Nov 15 14:25:02 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.objects.instance [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'trusted_certs' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG nova.objects.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Cannot resize image /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG nova.objects.instance [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'migration_context' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG nova.objects.base [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG os_vif [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15419c0f-5df6-57b2-9991-dab7b4d2f56c', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap904d19af-08, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap904d19af-08, col_values=(('qos', UUID('a52b8987-3e1a-4e2f-b6ff-efdff4ade2c5')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap904d19af-08, col_values=(('external_ids', {'iface-id': '904d19af-084f-43ac-8378-cf5b7e822961', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:62:55', 'vm-uuid': '45201330-05c4-4109-99c2-d17761f46add'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:25:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:03 user nova-compute[74892]: INFO os_vif [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08')
Nov 15 14:25:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-647ea77f-ba04-4282-b0e8-f7c41d2e93b0 req-6248c56a-301a-4a02-a8f7-efe89303e79d service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-647ea77f-ba04-4282-b0e8-f7c41d2e93b0 req-6248c56a-301a-4a02-a8f7-efe89303e79d service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-647ea77f-ba04-4282-b0e8-f7c41d2e93b0 req-6248c56a-301a-4a02-a8f7-efe89303e79d service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-647ea77f-ba04-4282-b0e8-f7c41d2e93b0 req-6248c56a-301a-4a02-a8f7-efe89303e79d service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-647ea77f-ba04-4282-b0e8-f7c41d2e93b0 req-6248c56a-301a-4a02-a8f7-efe89303e79d service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:04 user nova-compute[74892]: WARNING nova.compute.manager [req-647ea77f-ba04-4282-b0e8-f7c41d2e93b0 req-6248c56a-301a-4a02-a8f7-efe89303e79d service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state stopped and task_state powering-on.
Nov 15 14:25:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:25:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance rebooted successfully.
Nov 15 14:25:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-88017a26-3fee-4bdf-a93c-f03dfa90d4bb tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:25:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-d36993ca-307c-4cf9-ae1d-e80b4da02220 req-2e908945-4d81-456c-9e8a-c430ed5c6a6d service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d36993ca-307c-4cf9-ae1d-e80b4da02220 req-2e908945-4d81-456c-9e8a-c430ed5c6a6d service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d36993ca-307c-4cf9-ae1d-e80b4da02220 req-2e908945-4d81-456c-9e8a-c430ed5c6a6d service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d36993ca-307c-4cf9-ae1d-e80b4da02220 req-2e908945-4d81-456c-9e8a-c430ed5c6a6d service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-d36993ca-307c-4cf9-ae1d-e80b4da02220 req-2e908945-4d81-456c-9e8a-c430ed5c6a6d service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:07 user nova-compute[74892]: WARNING nova.compute.manager [req-d36993ca-307c-4cf9-ae1d-e80b4da02220 req-2e908945-4d81-456c-9e8a-c430ed5c6a6d service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state stopped and task_state powering-on.
Nov 15 14:25:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:25:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:25:14 user nova-compute[74892]: INFO nova.compute.claims [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Claim successful on node user
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:25:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.policy [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eccd14bd0c974f4a83aba63fd70df073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcc169292ce42fb9f54aab1db3869bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:25:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Creating image(s)
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "/opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "/opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "/opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.238s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk 1073741824" returned: 0 in 0.054s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Cannot resize image /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Ensure instance console log exists: /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Successfully created port: a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Successfully updated port: a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquired lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-c55d51dc-e02a-443c-8553-3500a94057bb req-3f02fced-8304-402d-96ba-b2326033b559 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received event network-changed-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-c55d51dc-e02a-443c-8553-3500a94057bb req-3f02fced-8304-402d-96ba-b2326033b559 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Refreshing instance network info cache due to event network-changed-a052c7fb-fc4c-4f52-81a6-9e4117355906. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c55d51dc-e02a-443c-8553-3500a94057bb req-3f02fced-8304-402d-96ba-b2326033b559 service nova] Acquiring lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Updating instance_info_cache with network_info: [{"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Releasing lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Instance network_info: |[{"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c55d51dc-e02a-443c-8553-3500a94057bb req-3f02fced-8304-402d-96ba-b2326033b559 service nova] Acquired lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.neutron [req-c55d51dc-e02a-443c-8553-3500a94057bb req-3f02fced-8304-402d-96ba-b2326033b559 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Refreshing network info cache for port a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Start _get_guest_xml network_info=[{"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:25:17 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:25:17 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-310410644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-310410644',id=28,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-if38prr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:25:16Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=a80d8849-d199-4b95-9c3b-d673bd0ded3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e5:f3,bridge_name='br-int',has_traffic_filtering=True,id=a052c7fb-fc4c-4f52-81a6-9e4117355906,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa052c7fb-fc') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'pci_devices' on Instance uuid a80d8849-d199-4b95-9c3b-d673bd0ded3c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:25:17 user nova-compute[74892]:   <uuid>a80d8849-d199-4b95-9c3b-d673bd0ded3c</uuid>
Nov 15 14:25:17 user nova-compute[74892]:   <name>instance-0000001c</name>
Nov 15 14:25:17 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:25:17 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:25:17 user nova-compute[74892]:   <metadata>
Nov 15 14:25:17 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:25:17 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:25:17 user nova-compute[74892]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-310410644</nova:name>
Nov 15 14:25:17 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:25:17</nova:creationTime>
Nov 15 14:25:17 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:25:17 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:25:17 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:25:17 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:25:17 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:25:17 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:25:17 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:25:17 user nova-compute[74892]:       <nova:owner>
Nov 15 14:25:17 user nova-compute[74892]:         <nova:user uuid="eccd14bd0c974f4a83aba63fd70df073">tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member</nova:user>
Nov 15 14:25:17 user nova-compute[74892]:         <nova:project uuid="3fcc169292ce42fb9f54aab1db3869bd">tempest-ServerBootFromVolumeStableRescueTest-760148567</nova:project>
Nov 15 14:25:17 user nova-compute[74892]:       </nova:owner>
Nov 15 14:25:17 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:25:17 user nova-compute[74892]:       <nova:ports>
Nov 15 14:25:17 user nova-compute[74892]:         <nova:port uuid="a052c7fb-fc4c-4f52-81a6-9e4117355906">
Nov 15 14:25:17 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:25:17 user nova-compute[74892]:         </nova:port>
Nov 15 14:25:17 user nova-compute[74892]:       </nova:ports>
Nov 15 14:25:17 user nova-compute[74892]:     </nova:instance>
Nov 15 14:25:17 user nova-compute[74892]:   </metadata>
Nov 15 14:25:17 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:25:17 user nova-compute[74892]:     <system>
Nov 15 14:25:17 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:25:17 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:25:17 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:25:17 user nova-compute[74892]:       <entry name="serial">a80d8849-d199-4b95-9c3b-d673bd0ded3c</entry>
Nov 15 14:25:17 user nova-compute[74892]:       <entry name="uuid">a80d8849-d199-4b95-9c3b-d673bd0ded3c</entry>
Nov 15 14:25:17 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:25:17 user nova-compute[74892]:     </system>
Nov 15 14:25:17 user nova-compute[74892]:   </sysinfo>
Nov 15 14:25:17 user nova-compute[74892]:   <os>
Nov 15 14:25:17 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:25:17 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:25:17 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:25:17 user nova-compute[74892]:   </os>
Nov 15 14:25:17 user nova-compute[74892]:   <features>
Nov 15 14:25:17 user nova-compute[74892]:     <acpi/>
Nov 15 14:25:17 user nova-compute[74892]:     <apic/>
Nov 15 14:25:17 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:25:17 user nova-compute[74892]:   </features>
Nov 15 14:25:17 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:25:17 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:25:17 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:25:17 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:25:17 user nova-compute[74892]:   </clock>
Nov 15 14:25:17 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:25:17 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:25:17 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:25:17 user nova-compute[74892]:   </cpu>
Nov 15 14:25:17 user nova-compute[74892]:   <devices>
Nov 15 14:25:17 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:25:17 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:25:17 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk"/>
Nov 15 14:25:17 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:25:17 user nova-compute[74892]:     </disk>
Nov 15 14:25:17 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:25:17 user nova-compute[74892]:       <mac address="fa:16:3e:a9:e5:f3"/>
Nov 15 14:25:17 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:25:17 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:25:17 user nova-compute[74892]:       <target dev="tapa052c7fb-fc"/>
Nov 15 14:25:17 user nova-compute[74892]:     </interface>
Nov 15 14:25:17 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:25:17 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/console.log" append="off"/>
Nov 15 14:25:17 user nova-compute[74892]:     </serial>
Nov 15 14:25:17 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:25:17 user nova-compute[74892]:     <video>
Nov 15 14:25:17 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:25:17 user nova-compute[74892]:     </video>
Nov 15 14:25:17 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:25:17 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:25:17 user nova-compute[74892]:     </rng>
Nov 15 14:25:17 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:25:17 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:25:17 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:25:17 user nova-compute[74892]:     </memballoon>
Nov 15 14:25:17 user nova-compute[74892]:   </devices>
Nov 15 14:25:17 user nova-compute[74892]: </domain>
Nov 15 14:25:17 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-310410644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-310410644',id=28,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-if38prr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:25:16Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=a80d8849-d199-4b95-9c3b-d673bd0ded3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e5:f3,bridge_name='br-int',has_traffic_filtering=True,id=a052c7fb-fc4c-4f52-81a6-9e4117355906,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa052c7fb-fc') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG os_vif [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e5:f3,bridge_name='br-int',has_traffic_filtering=True,id=a052c7fb-fc4c-4f52-81a6-9e4117355906,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa052c7fb-fc') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e22561f-d87c-5945-8ddf-cd57e4606780', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa052c7fb-fc, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa052c7fb-fc, col_values=(('qos', UUID('f0cbf5af-52a2-4459-a6d3-3981cc6e1f0b')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa052c7fb-fc, col_values=(('external_ids', {'iface-id': 'a052c7fb-fc4c-4f52-81a6-9e4117355906', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:e5:f3', 'vm-uuid': 'a80d8849-d199-4b95-9c3b-d673bd0ded3c'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:17 user nova-compute[74892]: INFO os_vif [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:e5:f3,bridge_name='br-int',has_traffic_filtering=True,id=a052c7fb-fc4c-4f52-81a6-9e4117355906,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa052c7fb-fc')
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:25:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No VIF found with MAC fa:16:3e:a9:e5:f3, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:25:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-c55d51dc-e02a-443c-8553-3500a94057bb req-3f02fced-8304-402d-96ba-b2326033b559 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Updated VIF entry in instance network info cache for port a052c7fb-fc4c-4f52-81a6-9e4117355906. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:25:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-c55d51dc-e02a-443c-8553-3500a94057bb req-3f02fced-8304-402d-96ba-b2326033b559 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Updating instance_info_cache with network_info: [{"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c55d51dc-e02a-443c-8553-3500a94057bb req-3f02fced-8304-402d-96ba-b2326033b559 service nova] Releasing lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:25:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-23bad5c9-eafd-4e6a-9ce0-3b4db652084b req-c807a08c-ed9c-45a4-bfd6-574b60dad3bd service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received event network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-23bad5c9-eafd-4e6a-9ce0-3b4db652084b req-c807a08c-ed9c-45a4-bfd6-574b60dad3bd service nova] Acquiring lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-23bad5c9-eafd-4e6a-9ce0-3b4db652084b req-c807a08c-ed9c-45a4-bfd6-574b60dad3bd service nova] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-23bad5c9-eafd-4e6a-9ce0-3b4db652084b req-c807a08c-ed9c-45a4-bfd6-574b60dad3bd service nova] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-23bad5c9-eafd-4e6a-9ce0-3b4db652084b req-c807a08c-ed9c-45a4-bfd6-574b60dad3bd service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] No waiting events found dispatching network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:19 user nova-compute[74892]: WARNING nova.compute.manager [req-23bad5c9-eafd-4e6a-9ce0-3b4db652084b req-c807a08c-ed9c-45a4-bfd6-574b60dad3bd service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received unexpected event network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 for instance with vm_state building and task_state spawning.
Nov 15 14:25:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:25:21 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Instance spawned successfully.
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-e5b44fc4-8839-4900-8b9c-7c167267b80c req-67248862-6f60-4b03-9353-73e7f63772f2 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received event network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e5b44fc4-8839-4900-8b9c-7c167267b80c req-67248862-6f60-4b03-9353-73e7f63772f2 service nova] Acquiring lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e5b44fc4-8839-4900-8b9c-7c167267b80c req-67248862-6f60-4b03-9353-73e7f63772f2 service nova] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e5b44fc4-8839-4900-8b9c-7c167267b80c req-67248862-6f60-4b03-9353-73e7f63772f2 service nova] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-e5b44fc4-8839-4900-8b9c-7c167267b80c req-67248862-6f60-4b03-9353-73e7f63772f2 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] No waiting events found dispatching network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:21 user nova-compute[74892]: WARNING nova.compute.manager [req-e5b44fc4-8839-4900-8b9c-7c167267b80c req-67248862-6f60-4b03-9353-73e7f63772f2 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received unexpected event network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 for instance with vm_state building and task_state spawning.
Nov 15 14:25:21 user nova-compute[74892]: INFO nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 15 14:25:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:25:21 user nova-compute[74892]: INFO nova.compute.manager [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Took 6.84 seconds to build instance.
Nov 15 14:25:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab13491e-28cb-4131-8377-c98c136d9b16 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.961s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-e8ab6eab-4eca-4f02-bb04-7516743cd5f7 req-287cf01a-d03f-4c14-ad57-672a4c5be55f service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-changed-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-e8ab6eab-4eca-4f02-bb04-7516743cd5f7 req-287cf01a-d03f-4c14-ad57-672a4c5be55f service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Refreshing instance network info cache due to event network-changed-f43c2ae9-479a-4103-b661-c3a715ff9540. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e8ab6eab-4eca-4f02-bb04-7516743cd5f7 req-287cf01a-d03f-4c14-ad57-672a4c5be55f service nova] Acquiring lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e8ab6eab-4eca-4f02-bb04-7516743cd5f7 req-287cf01a-d03f-4c14-ad57-672a4c5be55f service nova] Acquired lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG nova.network.neutron [req-e8ab6eab-4eca-4f02-bb04-7516743cd5f7 req-287cf01a-d03f-4c14-ad57-672a4c5be55f service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Refreshing network info cache for port f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'flavor' on Instance uuid ae627049-158a-4e50-9e9b-29fc7992345d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Ignoring supplied device name: /dev/vdb
Nov 15 14:25:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:27 user nova-compute[74892]: INFO nova.compute.manager [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Attaching volume e7edc0ee-f3a3-4088-adef-9b801599163e to /dev/vdb
Nov 15 14:25:27 user nova-compute[74892]: DEBUG nova.network.neutron [req-e8ab6eab-4eca-4f02-bb04-7516743cd5f7 req-287cf01a-d03f-4c14-ad57-672a4c5be55f service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Updated VIF entry in instance network info cache for port f43c2ae9-479a-4103-b661-c3a715ff9540. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG nova.network.neutron [req-e8ab6eab-4eca-4f02-bb04-7516743cd5f7 req-287cf01a-d03f-4c14-ad57-672a4c5be55f service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Updating instance_info_cache with network_info: [{"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG os_brick.utils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e8ab6eab-4eca-4f02-bb04-7516743cd5f7 req-287cf01a-d03f-4c14-ad57-672a4c5be55f service nova] Releasing lock "refresh_cache-ae627049-158a-4e50-9e9b-29fc7992345d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82ed73a-cd5b-4152-938b-2b86d01208fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[22336169-c80d-45c3-a57e-2d0c87f73ebb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0504f473-2059-4015-9ab5-72acf8f6164a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cef196a-c60a-4d8e-bf3e-9d91deff2f70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:25:27 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:25:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d83f41-30b1-4ad1-aa36-e5cbac43ec6b]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG os_brick.utils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Updating existing volume attachment record: 476c4829-0a82-4ecb-af04-42af05b08be6 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:25:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMGtiumI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:32 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:32 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:32 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d183336f-5a7e-458c-9437-b0aaeb47113d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:25:32 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2799bf-33be-4fa1-9dd2-e9bc184c8309]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e] added
Nov 15 14:25:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4bdd04-fba5-450f-a1d7-367aa0fa226d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2477137-2532-44d8-ae2a-03e43bd1af32]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMGtiumI {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: INFO nova.compute.manager [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Detaching volume 523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZMGtiumI" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58142aa-47b8-4b3e-ade6-9bbfeec2b616]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZMGtiumI'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2933ab63-42d6-494d-b93a-c38cc9fac249]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: INFO nova.virt.block_device [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Attempting to driver detach volume 523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc from mountpoint /dev/vdb
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Attempting to detach device vdb from instance 726e0f64-5808-4e5b-accf-190ed1537b44 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:25:32 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:25:32 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:25:32 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:25:32 user nova-compute[74892]:   <serial>523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc</serial>
Nov 15 14:25:32 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 14:25:32 user nova-compute[74892]: </disk>
Nov 15 14:25:32 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1159db6-d4d2-4dc6-a6dc-b384bb0530f2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully detached device vdb from instance 726e0f64-5808-4e5b-accf-190ed1537b44 from the persistent domain config.
Nov 15 14:25:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 726e0f64-5808-4e5b-accf-190ed1537b44 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:25:32 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:25:32 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:25:32 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:25:32 user nova-compute[74892]:   <serial>523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc</serial>
Nov 15 14:25:32 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 14:25:32 user nova-compute[74892]: </disk>
Nov 15 14:25:32 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dbfc8f-1da5-475e-bfda-814163851b91]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e, portal: 172.16.0.220,3260]
Nov 15 14:25:32 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e, portal: 172.16.0.220,3260] successful.
Nov 15 14:25:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8193da-4e8a-454f-9053-fe9b28e4bc89]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad6a723-f961-4345-b12d-0e2810677cb3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:32 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] HCTL ('41', '-', '-', 0) found on session 30 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85a99e7-c18b-42bd-b824-7300faa882a5]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Searching for a device in session 30 and hctl ['41', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:25:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 726e0f64-5808-4e5b-accf-190ed1537b44 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:25:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Searching for a device in session 30 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:25:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMGtiumI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:25:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23636326330663261', 'path': '/dev/sdj'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636326330663261', 'path': '/dev/sdj'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:25:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'flavor' on Instance uuid ae627049-158a-4e50-9e9b-29fc7992345d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:25:33 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:25:33 user nova-compute[74892]:   <source dev="/dev/sdj"/>
Nov 15 14:25:33 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:25:33 user nova-compute[74892]:   <serial>e7edc0ee-f3a3-4088-adef-9b801599163e</serial>
Nov 15 14:25:33 user nova-compute[74892]: </disk>
Nov 15 14:25:33 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No VIF found with MAC fa:16:3e:36:c6:df, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ef8338eb-80f1-4bc4-942d-2ca94d9aebc3 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.401s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:34 user nova-compute[74892]: INFO nova.compute.manager [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Terminating instance
Nov 15 14:25:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-30dd254f-4b2e-4c66-b6ed-f7e8b71b6b3d req-7708cced-a9c2-45c7-bf27-cdb6af9aa165 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-30dd254f-4b2e-4c66-b6ed-f7e8b71b6b3d req-7708cced-a9c2-45c7-bf27-cdb6af9aa165 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-30dd254f-4b2e-4c66-b6ed-f7e8b71b6b3d req-7708cced-a9c2-45c7-bf27-cdb6af9aa165 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-30dd254f-4b2e-4c66-b6ed-f7e8b71b6b3d req-7708cced-a9c2-45c7-bf27-cdb6af9aa165 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-30dd254f-4b2e-4c66-b6ed-f7e8b71b6b3d req-7708cced-a9c2-45c7-bf27-cdb6af9aa165 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-30dd254f-4b2e-4c66-b6ed-f7e8b71b6b3d req-7708cced-a9c2-45c7-bf27-cdb6af9aa165 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-unplugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:25:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Instance destroyed successfully.
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lazy-loading 'resources' on Instance uuid 2cd7a807-53cb-44d6-91cd-3a58b36f2963 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-151320545',display_name='tempest-ServerActionsTestOtherB-server-151320545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-151320545',id=2,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ap5/X+9L1U5O+MMoN37gw+BgPkrd8H+G1QYmmrOn4Ur4/pqsCa/ylSbhdNwbPuoztlyoNp6jbMiQ/jWIPRSPiNUmzMgB/TWFeEEmpYVIEbkmt5Bwy95RTD4erF3Oz5A==',key_name='tempest-keypair-2052148126',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:23:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7fe4fd8971a248c0a7058a1ff448ac92',ramdisk_id='',reservation_id='r-9f8xvjd4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1188247760',owner_user_name='tempest-ServerActionsTestOtherB-1188247760-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='971828fdd5de481faf9ff0403ecdd3b0',uuid=2cd7a807-53cb-44d6-91cd-3a58b36f2963,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converting VIF {"id": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "address": "fa:16:3e:3d:a8:cd", "network": {"id": "8679c336-5c14-4ec8-9025-71ef02af5847", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1703018691-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7fe4fd8971a248c0a7058a1ff448ac92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4426f0fd-a2", "ovs_interfaceid": "4426f0fd-a229-4b73-a68e-6b9456304d1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_vif [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4426f0fd-a2, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=698a9724-19d1-482b-81b1-bdff92752b5d) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:35 user nova-compute[74892]: INFO os_vif [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:a8:cd,bridge_name='br-int',has_traffic_filtering=True,id=4426f0fd-a229-4b73-a68e-6b9456304d1c,network=Network(8679c336-5c14-4ec8-9025-71ef02af5847),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4426f0fd-a2')
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yihUezAH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:35 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[96987220-2ec3-408e-8792-1b8b0d61c3a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:25:35 user nova-compute[74892]: No targets found.
Nov 15 14:25:35 user nova-compute[74892]: iSNS:
Nov 15 14:25:35 user nova-compute[74892]: No targets found.
Nov 15 14:25:35 user nova-compute[74892]: STATIC:
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb
Nov 15 14:25:35 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:35 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:35 user nova-compute[74892]: FIRMWARE:
Nov 15 14:25:35 user nova-compute[74892]: No targets found.
Nov 15 14:25:35 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:25:35 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:25:35 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2846e5e-63fb-4936-bc03-4acc1de376ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed45641f-18c3-416f-9581-689c8d3202f6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:35 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:35 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:35 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd006031c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8'): ({'sde'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Removing single pathed devices sde {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd8835-8cd9-47ce-874b-582ebc042161]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d600e5a2-bdae-47f5-8ca8-20420843e6a7]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Flushing IO for device /dev/sde {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aadc35-963c-45b9-b9f8-c4354d51b050]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[34428202-1aa3-4e45-9893-6636ad47382f]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca20f10-dfb3-4b3f-869f-9b82f83a97fe]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9411a199-3fde-47c1-b079-8b0e71f7ce31]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260]
Nov 15 14:25:35 user nova-compute[74892]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8, portal: 172.16.0.220,3260] successful.
Nov 15 14:25:35 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2faf3f-3393-465a-89b4-f7601e07c2e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbe9297-2b5e-4e1b-b7d2-067ffb16138f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] <== disconnect_volume: return (361ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:25:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Deleting instance files /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963_del
Nov 15 14:25:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Deletion of /opt/stack/data/nova/instances/2cd7a807-53cb-44d6-91cd-3a58b36f2963_del complete
Nov 15 14:25:36 user nova-compute[74892]: INFO nova.compute.manager [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Took 1.47 seconds to destroy the instance on the hypervisor.
Nov 15 14:25:36 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:25:36 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:25:36 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:25:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:36 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:36 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Took 0.94 seconds to deallocate network for instance.
Nov 15 14:25:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-c43955c6-d282-43cd-8a92-f0bb7923d138 req-b72d82cf-a1d5-43a8-bd11-b02f3cb28e8d service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-deleted-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:36 user nova-compute[74892]: INFO nova.compute.manager [req-c43955c6-d282-43cd-8a92-f0bb7923d138 req-b72d82cf-a1d5-43a8-bd11-b02f3cb28e8d service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Neutron deleted interface 4426f0fd-a229-4b73-a68e-6b9456304d1c; detaching it from the instance and deleting it from the info cache
Nov 15 14:25:36 user nova-compute[74892]: DEBUG nova.network.neutron [req-c43955c6-d282-43cd-8a92-f0bb7923d138 req-b72d82cf-a1d5-43a8-bd11-b02f3cb28e8d service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-c43955c6-d282-43cd-8a92-f0bb7923d138 req-b72d82cf-a1d5-43a8-bd11-b02f3cb28e8d service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Detach interface failed, port_id=4426f0fd-a229-4b73-a68e-6b9456304d1c, reason: Instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:25:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-dcf084ce-4096-4e71-a6c1-a90d5bef6548 req-5adf9da2-fc1c-43d9-bc45-071f66a36641 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dcf084ce-4096-4e71-a6c1-a90d5bef6548 req-5adf9da2-fc1c-43d9-bc45-071f66a36641 service nova] Acquiring lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dcf084ce-4096-4e71-a6c1-a90d5bef6548 req-5adf9da2-fc1c-43d9-bc45-071f66a36641 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dcf084ce-4096-4e71-a6c1-a90d5bef6548 req-5adf9da2-fc1c-43d9-bc45-071f66a36641 service nova] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-dcf084ce-4096-4e71-a6c1-a90d5bef6548 req-5adf9da2-fc1c-43d9-bc45-071f66a36641 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] No waiting events found dispatching network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:37 user nova-compute[74892]: WARNING nova.compute.manager [req-dcf084ce-4096-4e71-a6c1-a90d5bef6548 req-5adf9da2-fc1c-43d9-bc45-071f66a36641 service nova] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Received unexpected event network-vif-plugged-4426f0fd-a229-4b73-a68e-6b9456304d1c for instance with vm_state active and task_state deleting.
Nov 15 14:25:37 user nova-compute[74892]: INFO nova.compute.manager [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] [instance: 2cd7a807-53cb-44d6-91cd-3a58b36f2963] Took 0.85 seconds to detach 1 volumes for instance.
Nov 15 14:25:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:38 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:25:38 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:25:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:38 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Deleted allocations for instance 2cd7a807-53cb-44d6-91cd-3a58b36f2963
Nov 15 14:25:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-27353470-c1c3-47d4-aa19-8acff7f823d9 tempest-ServerActionsTestOtherB-1188247760 tempest-ServerActionsTestOtherB-1188247760-project-member] Lock "2cd7a807-53cb-44d6-91cd-3a58b36f2963" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.901s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG nova.objects.instance [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'flavor' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:39 user nova-compute[74892]: INFO nova.compute.manager [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Attaching volume 5330b2fc-675d-435e-a878-71ec42854e22 to /dev/vdb
Nov 15 14:25:39 user nova-compute[74892]: DEBUG os_brick.utils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fa80cc-6587-42e0-bdbf-0ad95c4bd346]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d644176-5d0b-447d-84b1-452772138824]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed274e-793e-4e9a-b0fe-42cec07bf8d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1444efe1-d64f-41c2-9277-72c3a48e4e82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:25:39 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d4f948-50bd-4c6e-bf1b-af1fbb14b6d0]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG os_brick.utils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating existing volume attachment record: 0d4e4c9b-8104-466e-8730-96caa4d539cf {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:25:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:25:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-0c9abbb8-ae21-4588-89a9-9d498963a846 req-03a1ccc9-594a-485c-b6ac-d6157fc712a2 service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received event network-changed-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-0c9abbb8-ae21-4588-89a9-9d498963a846 req-03a1ccc9-594a-485c-b6ac-d6157fc712a2 service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Refreshing instance network info cache due to event network-changed-35491745-14cd-4e95-8217-6a0f6fc2bb55. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0c9abbb8-ae21-4588-89a9-9d498963a846 req-03a1ccc9-594a-485c-b6ac-d6157fc712a2 service nova] Acquiring lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0c9abbb8-ae21-4588-89a9-9d498963a846 req-03a1ccc9-594a-485c-b6ac-d6157fc712a2 service nova] Acquired lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG nova.network.neutron [req-0c9abbb8-ae21-4588-89a9-9d498963a846 req-03a1ccc9-594a-485c-b6ac-d6157fc712a2 service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Refreshing network info cache for port 35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "39653e2d-4446-4d30-a787-d16c9f5ca47f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:41 user nova-compute[74892]: INFO nova.compute.manager [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Terminating instance
Nov 15 14:25:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-0c9abbb8-ae21-4588-89a9-9d498963a846 req-03a1ccc9-594a-485c-b6ac-d6157fc712a2 service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Updated VIF entry in instance network info cache for port 35491745-14cd-4e95-8217-6a0f6fc2bb55. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-0c9abbb8-ae21-4588-89a9-9d498963a846 req-03a1ccc9-594a-485c-b6ac-d6157fc712a2 service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Updating instance_info_cache with network_info: [{"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Instance destroyed successfully.
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'resources' on Instance uuid 39653e2d-4446-4d30-a787-d16c9f5ca47f {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:23:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-518539722',display_name='tempest-AttachVolumeNegativeTest-server-518539722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-518539722',id=24,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJAjn7VUL6jvRCDmdfvXFM97ElpeKQ2z20LPBeNKrIYQovqaBl2FXtnEjb2KTWnElzDpoSQ9LjtEtNOpXLyVZBueYWYm1O+BaeZG0pCRdJZUCTnNuDSFIVXQA1zU0gWKw==',key_name='tempest-keypair-11583283',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:23:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-h151loq9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:23:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=39653e2d-4446-4d30-a787-d16c9f5ca47f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "address": "fa:16:3e:ea:30:25", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35491745-14", "ovs_interfaceid": "35491745-14cd-4e95-8217-6a0f6fc2bb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:25,bridge_name='br-int',has_traffic_filtering=True,id=35491745-14cd-4e95-8217-6a0f6fc2bb55,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35491745-14') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG os_vif [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:25,bridge_name='br-int',has_traffic_filtering=True,id=35491745-14cd-4e95-8217-6a0f6fc2bb55,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35491745-14') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0c9abbb8-ae21-4588-89a9-9d498963a846 req-03a1ccc9-594a-485c-b6ac-d6157fc712a2 service nova] Releasing lock "refresh_cache-39653e2d-4446-4d30-a787-d16c9f5ca47f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35491745-14, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=248d5031-b589-4d68-ab6f-6ac44561089d) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:42 user nova-compute[74892]: INFO os_vif [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:30:25,bridge_name='br-int',has_traffic_filtering=True,id=35491745-14cd-4e95-8217-6a0f6fc2bb55,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap35491745-14')
Nov 15 14:25:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Deleting instance files /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f_del
Nov 15 14:25:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Deletion of /opt/stack/data/nova/instances/39653e2d-4446-4d30-a787-d16c9f5ca47f_del complete
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-557544be-2750-454b-9b4c-87dcff13d0b3 req-f521e4c9-3072-491f-a97d-7d330655cf6e service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received event network-vif-unplugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-557544be-2750-454b-9b4c-87dcff13d0b3 req-f521e4c9-3072-491f-a97d-7d330655cf6e service nova] Acquiring lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-557544be-2750-454b-9b4c-87dcff13d0b3 req-f521e4c9-3072-491f-a97d-7d330655cf6e service nova] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-557544be-2750-454b-9b4c-87dcff13d0b3 req-f521e4c9-3072-491f-a97d-7d330655cf6e service nova] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-557544be-2750-454b-9b4c-87dcff13d0b3 req-f521e4c9-3072-491f-a97d-7d330655cf6e service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] No waiting events found dispatching network-vif-unplugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.compute.manager [req-557544be-2750-454b-9b4c-87dcff13d0b3 req-f521e4c9-3072-491f-a97d-7d330655cf6e service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received event network-vif-unplugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:25:42 user nova-compute[74892]: INFO nova.compute.manager [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:43 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Took 0.91 seconds to deallocate network for instance.
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Error from libvirt while getting description of instance-00000018: [Error Code 42] Domain not found: no domain with matching uuid '39653e2d-4446-4d30-a787-d16c9f5ca47f' (instance-00000018): libvirt.libvirtError: Domain not found: no domain with matching uuid '39653e2d-4446-4d30-a787-d16c9f5ca47f' (instance-00000018)
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.007s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:25:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=6946MB free_disk=25.06517791748047GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:44 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Deleted allocations for instance 39653e2d-4446-4d30-a787-d16c9f5ca47f
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-96ac33c5-19bb-41e2-813e-a354bab54d0c req-aae81183-60e8-4cd0-a8c8-cbcb5bb9060e service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received event network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-96ac33c5-19bb-41e2-813e-a354bab54d0c req-aae81183-60e8-4cd0-a8c8-cbcb5bb9060e service nova] Acquiring lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-96ac33c5-19bb-41e2-813e-a354bab54d0c req-aae81183-60e8-4cd0-a8c8-cbcb5bb9060e service nova] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-96ac33c5-19bb-41e2-813e-a354bab54d0c req-aae81183-60e8-4cd0-a8c8-cbcb5bb9060e service nova] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-96ac33c5-19bb-41e2-813e-a354bab54d0c req-aae81183-60e8-4cd0-a8c8-cbcb5bb9060e service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] No waiting events found dispatching network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:44 user nova-compute[74892]: WARNING nova.compute.manager [req-96ac33c5-19bb-41e2-813e-a354bab54d0c req-aae81183-60e8-4cd0-a8c8-cbcb5bb9060e service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received unexpected event network-vif-plugged-35491745-14cd-4e95-8217-6a0f6fc2bb55 for instance with vm_state deleted and task_state None.
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-96ac33c5-19bb-41e2-813e-a354bab54d0c req-aae81183-60e8-4cd0-a8c8-cbcb5bb9060e service nova] [instance: 39653e2d-4446-4d30-a787-d16c9f5ca47f] Received event network-vif-deleted-35491745-14cd-4e95-8217-6a0f6fc2bb55 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ad0b6022-27b7-45a2-a093-0c51583ef64c tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "39653e2d-4446-4d30-a787-d16c9f5ca47f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.147s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 726e0f64-5808-4e5b-accf-190ed1537b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d013f581-2c2a-4935-98d5-53b0904118ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9e258725-b58a-46c8-a2f0-099e246564a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ae627049-158a-4e50-9e9b-29fc7992345d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 5267e3dc-3c08-4046-836c-6ac540f0476d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1737a0c1-61e0-44ff-b172-90b9e758781b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyUVeilh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:44 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[192ad2d3-8a29-450c-9ca5-d77cea40e7f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:25:44 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41fb480-f6a3-4546-b4de-10f9e2ea7d96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22] added
Nov 15 14:25:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[99045258-c756-4b3f-976b-325d8dc14def]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[321ddd9c-cb7a-4b8b-b414-c2e1b7ebcb5b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyUVeilh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyUVeilh" returned: 0 in 0.038s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc88d75-7c79-4aa2-9d2d-2a53bedd76f5]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyUVeilh'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f425c67a-85a2-4f75-9dca-0a2ed50d2668]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3955bf6-9aae-4b75-a90f-404404d859ec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:44 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9b4b76-0087-45a5-9fc6-681601e4eb7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22, portal: 172.16.0.220,3260]
Nov 15 14:25:45 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22, portal: 172.16.0.220,3260] successful.
Nov 15 14:25:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe41c8a-8975-4ae2-8897-c9242f7d70df]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7089f2-849f-49a6-a4bf-4f216902220d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:25:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:45 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:25:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abee750-9abc-44a1-94ad-77e7325e17f4]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyUVeilh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:25:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23039306335643738', 'path': '/dev/sde'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039306335643738', 'path': '/dev/sde'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG nova.objects.instance [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'flavor' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:25:46 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:25:46 user nova-compute[74892]:   <source dev="/dev/sde"/>
Nov 15 14:25:46 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:25:46 user nova-compute[74892]:   <serial>5330b2fc-675d-435e-a878-71ec42854e22</serial>
Nov 15 14:25:46 user nova-compute[74892]: </disk>
Nov 15 14:25:46 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No VIF found with MAC fa:16:3e:13:dd:80, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:25:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-67c5d470-8b40-4e52-8c80-52efc5b22048 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.377s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:47 user nova-compute[74892]: INFO nova.compute.manager [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Rescuing
Nov 15 14:25:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:25:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquired lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:25:47 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:25:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:47 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Releasing lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-a5addd10-c91b-4a29-9f8e-137c9e8feb14 req-ccf2bedb-35b3-46f5-ae4e-b9ec63034563 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a5addd10-c91b-4a29-9f8e-137c9e8feb14 req-ccf2bedb-35b3-46f5-ae4e-b9ec63034563 service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a5addd10-c91b-4a29-9f8e-137c9e8feb14 req-ccf2bedb-35b3-46f5-ae4e-b9ec63034563 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a5addd10-c91b-4a29-9f8e-137c9e8feb14 req-ccf2bedb-35b3-46f5-ae4e-b9ec63034563 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-a5addd10-c91b-4a29-9f8e-137c9e8feb14 req-ccf2bedb-35b3-46f5-ae4e-b9ec63034563 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:48 user nova-compute[74892]: WARNING nova.compute.manager [req-a5addd10-c91b-4a29-9f8e-137c9e8feb14 req-ccf2bedb-35b3-46f5-ae4e-b9ec63034563 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state active and task_state rescuing.
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:48 user nova-compute[74892]: INFO nova.compute.manager [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Detaching volume e7edc0ee-f3a3-4088-adef-9b801599163e
Nov 15 14:25:48 user nova-compute[74892]: INFO nova.virt.block_device [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Attempting to driver detach volume e7edc0ee-f3a3-4088-adef-9b801599163e from mountpoint /dev/vdb
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Attempting to detach device vdb from instance ae627049-158a-4e50-9e9b-29fc7992345d from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:25:48 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:25:48 user nova-compute[74892]:   <source dev="/dev/sdj"/>
Nov 15 14:25:48 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:25:48 user nova-compute[74892]:   <serial>e7edc0ee-f3a3-4088-adef-9b801599163e</serial>
Nov 15 14:25:48 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:25:48 user nova-compute[74892]: </disk>
Nov 15 14:25:48 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:25:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Successfully detached device vdb from instance ae627049-158a-4e50-9e9b-29fc7992345d from the persistent domain config.
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae627049-158a-4e50-9e9b-29fc7992345d from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:25:48 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:25:48 user nova-compute[74892]:   <source dev="/dev/sdj"/>
Nov 15 14:25:48 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:25:48 user nova-compute[74892]:   <serial>e7edc0ee-f3a3-4088-adef-9b801599163e</serial>
Nov 15 14:25:48 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:25:48 user nova-compute[74892]: </disk>
Nov 15 14:25:48 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:25:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance destroyed successfully.
Nov 15 14:25:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Attempting a stable device rescue
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74892) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance directory exists: not creating {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 14:25:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Creating image(s)
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "86ed8aeff7bd27845c8d7f9e550f2b374e65cf43" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "86ed8aeff7bd27845c8d7f9e550f2b374e65cf43" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae627049-158a-4e50-9e9b-29fc7992345d {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:25:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:49 user nova-compute[74892]: DEBUG nova.virt.images [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] 4ed02d2d-0cb5-4a7f-974a-0f518ffa1b57 was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:25:49 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:25:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43.part /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-dbffaf98-6962-4c4d-a80a-2a763496e8f5 req-90577029-7f47-492e-8b8a-eb5dee2052df service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dbffaf98-6962-4c4d-a80a-2a763496e8f5 req-90577029-7f47-492e-8b8a-eb5dee2052df service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dbffaf98-6962-4c4d-a80a-2a763496e8f5 req-90577029-7f47-492e-8b8a-eb5dee2052df service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dbffaf98-6962-4c4d-a80a-2a763496e8f5 req-90577029-7f47-492e-8b8a-eb5dee2052df service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-dbffaf98-6962-4c4d-a80a-2a763496e8f5 req-90577029-7f47-492e-8b8a-eb5dee2052df service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:50 user nova-compute[74892]: WARNING nova.compute.manager [req-dbffaf98-6962-4c4d-a80a-2a763496e8f5 req-90577029-7f47-492e-8b8a-eb5dee2052df service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state active and task_state rescuing.
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43.part /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43.converted" returned: 0 in 0.449s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "86ed8aeff7bd27845c8d7f9e550f2b374e65cf43" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.804s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "86ed8aeff7bd27845c8d7f9e550f2b374e65cf43" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "86ed8aeff7bd27845c8d7f9e550f2b374e65cf43" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43 --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43 --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43,backing_fmt=raw /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.rescue {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43,backing_fmt=raw /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.rescue" returned: 0 in 0.051s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "86ed8aeff7bd27845c8d7f9e550f2b374e65cf43" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'migration_context' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.objects.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Object Instance<9e258725-b58a-46c8-a2f0-099e246564a6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Start _get_guest_xml network_info=[{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "vif_mac": "fa:16:3e:13:dd:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4ed02d2d-0cb5-4a7f-974a-0f518ffa1b57', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyUVeilh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9e258725-b58a-46c8-a2f0-099e246564a6', 'attached_at': '', 'detached_at': '', 'volume_id': '5330b2fc-675d-435e-a878-71ec42854e22', 'serial': '5330b2fc-675d-435e-a878-71ec42854e22'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '0d4e4c9b-8104-466e-8730-96caa4d539cf', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'resources' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.objects.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Object Instance<9e258725-b58a-46c8-a2f0-099e246564a6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'numa_topology' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.objects.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Object Instance<9e258725-b58a-46c8-a2f0-099e246564a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:50 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:25:50 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.objects.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Object Instance<9e258725-b58a-46c8-a2f0-099e246564a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyUVeilh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:50 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:50 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:50 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:25:50 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating instance_info_cache with network_info: [{"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:25:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fb5ad6-083c-4e80-9b89-0def01c5588a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PyUVeilh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 14:25:51 user nova-compute[74892]: node.name = iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:25:51 user nova-compute[74892]: node.tpgt = -1
Nov 15 14:25:51 user nova-compute[74892]: node.startup = automatic
Nov 15 14:25:51 user nova-compute[74892]: node.leading_login = No
Nov 15 14:25:51 user nova-compute[74892]: iface.iscsi_ifacename = default
Nov 15 14:25:51 user nova-compute[74892]: iface.net_ifacename = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.ipaddress = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.prefix_len = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.hwaddress = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.transport_name = tcp
Nov 15 14:25:51 user nova-compute[74892]: iface.initiatorname = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.state = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.vlan_id = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.vlan_priority = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.vlan_state = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.iface_num = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.mtu = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.port = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.bootproto = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.subnet_mask = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.gateway = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.dhcp_alt_client_id = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.dhcp_dns = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.dhcp_learn_iqn = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.dhcp_vendor_id_state = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.dhcp_vendor_id = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.dhcp_slp_da = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.fragmentation = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.gratuitous_arp = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.incoming_forwarding = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.tos_state = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.tos = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.ttl = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.delayed_ack = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.tcp_nagle = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.tcp_wsf_state = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.tcp_wsf = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.tcp_timer_scale = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.tcp_timestamp = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.redirect = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.def_task_mgmt_timeout = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.header_digest = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.data_digest = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.immediate_data = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.initial_r2t = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.data_seq_inorder = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.data_pdu_inorder = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.erl = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.max_receive_data_len = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.first_burst_len = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.max_outstanding_r2t = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.max_burst_len = 0
Nov 15 14:25:51 user nova-compute[74892]: iface.chap_auth = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.bidi_chap = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.strict_login_compliance = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.discovery_auth = <empty>
Nov 15 14:25:51 user nova-compute[74892]: iface.discovery_logout = <empty>
Nov 15 14:25:51 user nova-compute[74892]: node.discovery_address = <empty>
Nov 15 14:25:51 user nova-compute[74892]: node.discovery_port = 0
Nov 15 14:25:51 user nova-compute[74892]: node.discovery_type = static
Nov 15 14:25:51 user nova-compute[74892]: node.session.initial_cmdsn = 0
Nov 15 14:25:51 user nova-compute[74892]: node.session.initial_login_retry_max = 8
Nov 15 14:25:51 user nova-compute[74892]: node.session.xmit_thread_priority = -20
Nov 15 14:25:51 user nova-compute[74892]: node.session.cmds_max = 128
Nov 15 14:25:51 user nova-compute[74892]: node.session.queue_depth = 32
Nov 15 14:25:51 user nova-compute[74892]: node.session.nr_sessions = 1
Nov 15 14:25:51 user nova-compute[74892]: node.session.auth.authmethod = CHAP
Nov 15 14:25:51 user nova-compute[74892]: node.session.auth.username = PyUVeilh
Nov 15 14:25:51 user nova-compute[74892]: node.session.auth.password = ***
Nov 15 14:25:51 user nova-compute[74892]: node.session.auth.username_in = <empty>
Nov 15 14:25:51 user nova-compute[74892]: node.session.auth.password_in = <empty>
Nov 15 14:25:51 user nova-compute[74892]: node.session.auth.chap_algs = MD5
Nov 15 14:25:51 user nova-compute[74892]: node.session.timeo.replacement_timeout = 120
Nov 15 14:25:51 user nova-compute[74892]: node.session.err_timeo.abort_timeout = 15
Nov 15 14:25:51 user nova-compute[74892]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 14:25:51 user nova-compute[74892]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 14:25:51 user nova-compute[74892]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.FastAbort = Yes
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.InitialR2T = No
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.ImmediateData = Yes
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.MaxConnections = 1
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 14:25:51 user nova-compute[74892]: node.session.iscsi.ERL = 0
Nov 15 14:25:51 user nova-compute[74892]: node.session.scan = manual
Nov 15 14:25:51 user nova-compute[74892]: node.session.reopen_max = 0
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].address = 172.16.0.220
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].port = 3260
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].startup = manual
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].tcp.window_size = 524288
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].tcp.type_of_service = 0
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].timeo.logout_timeout = 15
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].timeo.login_timeout = 15
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].timeo.auth_timeout = 45
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].iscsi.DataDigest = None
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].iscsi.IFMarker = No
Nov 15 14:25:51 user nova-compute[74892]: node.conn[0].iscsi.OFMarker = No
Nov 15 14:25:51 user nova-compute[74892]: # END RECORD
Nov 15 14:25:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2badfcd-fe91-45f3-82fb-4264c7e66cf0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e629e3-1094-4f2f-9fbf-79c1e3a23a32]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyUVeilh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyUVeilh" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fc2fcb-b3e5-47d8-a965-b2de3d10f88d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyUVeilh'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[117aff06-d1ea-4b31-a493-62757cc70241]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[488d0d11-86ac-4ae5-a94a-d8344ec5610b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:25:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:51 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:25:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] HCTL ('36', '0', '0', 0) found on session 31 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f8171-0b44-4347-9bee-a434b92602ed]: (4, ('0 0 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Searching for a device in session 31 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyUVeilh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23039306335643738', 'path': '/dev/sde'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039306335643738', 'path': '/dev/sde'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1081380142',display_name='tempest-ServerStableDeviceRescueTest-server-1081380142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1081380142',id=21,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOEreWdSOh9C27OYv86KjUTql4Rj3DRrNfHz2wGjnrubcIDTk0yVVpeP/AIl3K9epUmRd45ekF5xJFn1eG0oe7Xow4qhLkHUh7OeXBDj2B+4tbr9ZyTAif/+eLweDmR0Q==',key_name='tempest-keypair-1042147050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:22:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ace93cdac442c087c0ee565ce6d91f',ramdisk_id='',reservation_id='r-k69uypdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1573183010',owner_user_name='tempest-ServerStableDeviceRescueTest-1573183010-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:23:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2d08093aaa041d19f085ff9b5f822db',uuid=9e258725-b58a-46c8-a2f0-099e246564a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "vif_mac": "fa:16:3e:13:dd:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Converting VIF {"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "vif_mac": "fa:16:3e:13:dd:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:dd:80,bridge_name='br-int',has_traffic_filtering=True,id=ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6,network=Network(0f9ef846-aa53-4f02-bdfd-7400a9942de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5b32a8-6a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.objects.base [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Object Instance<9e258725-b58a-46c8-a2f0-099e246564a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:25:51 user nova-compute[74892]:   <uuid>9e258725-b58a-46c8-a2f0-099e246564a6</uuid>
Nov 15 14:25:51 user nova-compute[74892]:   <name>instance-00000015</name>
Nov 15 14:25:51 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:25:51 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:25:51 user nova-compute[74892]:   <metadata>
Nov 15 14:25:51 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:25:51 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:25:51 user nova-compute[74892]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1081380142</nova:name>
Nov 15 14:25:51 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:25:50</nova:creationTime>
Nov 15 14:25:51 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:25:51 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:25:51 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:25:51 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:25:51 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:25:51 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:25:51 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:25:51 user nova-compute[74892]:       <nova:owner>
Nov 15 14:25:51 user nova-compute[74892]:         <nova:user uuid="d2d08093aaa041d19f085ff9b5f822db">tempest-ServerStableDeviceRescueTest-1573183010-project-member</nova:user>
Nov 15 14:25:51 user nova-compute[74892]:         <nova:project uuid="d0ace93cdac442c087c0ee565ce6d91f">tempest-ServerStableDeviceRescueTest-1573183010</nova:project>
Nov 15 14:25:51 user nova-compute[74892]:       </nova:owner>
Nov 15 14:25:51 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:25:51 user nova-compute[74892]:       <nova:ports>
Nov 15 14:25:51 user nova-compute[74892]:         <nova:port uuid="ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6">
Nov 15 14:25:51 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 14:25:51 user nova-compute[74892]:         </nova:port>
Nov 15 14:25:51 user nova-compute[74892]:       </nova:ports>
Nov 15 14:25:51 user nova-compute[74892]:     </nova:instance>
Nov 15 14:25:51 user nova-compute[74892]:   </metadata>
Nov 15 14:25:51 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:25:51 user nova-compute[74892]:     <system>
Nov 15 14:25:51 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:25:51 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:25:51 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:25:51 user nova-compute[74892]:       <entry name="serial">9e258725-b58a-46c8-a2f0-099e246564a6</entry>
Nov 15 14:25:51 user nova-compute[74892]:       <entry name="uuid">9e258725-b58a-46c8-a2f0-099e246564a6</entry>
Nov 15 14:25:51 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:25:51 user nova-compute[74892]:     </system>
Nov 15 14:25:51 user nova-compute[74892]:   </sysinfo>
Nov 15 14:25:51 user nova-compute[74892]:   <os>
Nov 15 14:25:51 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:25:51 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:25:51 user nova-compute[74892]:   </os>
Nov 15 14:25:51 user nova-compute[74892]:   <features>
Nov 15 14:25:51 user nova-compute[74892]:     <acpi/>
Nov 15 14:25:51 user nova-compute[74892]:     <apic/>
Nov 15 14:25:51 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:25:51 user nova-compute[74892]:   </features>
Nov 15 14:25:51 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:25:51 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:25:51 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:25:51 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:25:51 user nova-compute[74892]:   </clock>
Nov 15 14:25:51 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:25:51 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:25:51 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:25:51 user nova-compute[74892]:   </cpu>
Nov 15 14:25:51 user nova-compute[74892]:   <devices>
Nov 15 14:25:51 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:25:51 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:25:51 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk"/>
Nov 15 14:25:51 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:25:51 user nova-compute[74892]:     </disk>
Nov 15 14:25:51 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:25:51 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:25:51 user nova-compute[74892]:       <source dev="/dev/sde"/>
Nov 15 14:25:51 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:25:51 user nova-compute[74892]:       <serial>5330b2fc-675d-435e-a878-71ec42854e22</serial>
Nov 15 14:25:51 user nova-compute[74892]:     </disk>
Nov 15 14:25:51 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:25:51 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:25:51 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.rescue"/>
Nov 15 14:25:51 user nova-compute[74892]:       <target dev="vdc" bus="virtio"/>
Nov 15 14:25:51 user nova-compute[74892]:       <boot order="1"/>
Nov 15 14:25:51 user nova-compute[74892]:     </disk>
Nov 15 14:25:51 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:25:51 user nova-compute[74892]:       <mac address="fa:16:3e:13:dd:80"/>
Nov 15 14:25:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:25:51 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:25:51 user nova-compute[74892]:       <target dev="tapec5b32a8-6a"/>
Nov 15 14:25:51 user nova-compute[74892]:     </interface>
Nov 15 14:25:51 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:25:51 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/console.log" append="off"/>
Nov 15 14:25:51 user nova-compute[74892]:     </serial>
Nov 15 14:25:51 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:25:51 user nova-compute[74892]:     <video>
Nov 15 14:25:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:25:51 user nova-compute[74892]:     </video>
Nov 15 14:25:51 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:25:51 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:25:51 user nova-compute[74892]:     </rng>
Nov 15 14:25:51 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:25:51 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:25:51 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:25:51 user nova-compute[74892]:     </memballoon>
Nov 15 14:25:51 user nova-compute[74892]:   </devices>
Nov 15 14:25:51 user nova-compute[74892]: </domain>
Nov 15 14:25:51 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:25:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance destroyed successfully.
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] No VIF found with MAC fa:16:3e:13:dd:80, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:25:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-4987c95c-fbf9-4b4e-8881-419cec19fb9d req-75de0dbe-ef76-4562-a5c9-a30616865472 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4987c95c-fbf9-4b4e-8881-419cec19fb9d req-75de0dbe-ef76-4562-a5c9-a30616865472 service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4987c95c-fbf9-4b4e-8881-419cec19fb9d req-75de0dbe-ef76-4562-a5c9-a30616865472 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4987c95c-fbf9-4b4e-8881-419cec19fb9d req-75de0dbe-ef76-4562-a5c9-a30616865472 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-4987c95c-fbf9-4b4e-8881-419cec19fb9d req-75de0dbe-ef76-4562-a5c9-a30616865472 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:52 user nova-compute[74892]: WARNING nova.compute.manager [req-4987c95c-fbf9-4b4e-8881-419cec19fb9d req-75de0dbe-ef76-4562-a5c9-a30616865472 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state active and task_state rescuing.
Nov 15 14:25:53 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 726e0f64-5808-4e5b-accf-190ed1537b44 is timed out.
Nov 15 14:25:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully detached device vdb from instance 726e0f64-5808-4e5b-accf-190ed1537b44 from the live domain config.
Nov 15 14:25:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkgwAsKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:25:53 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[202433a3-e862-477a-aeb7-92931ad19bdc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:25:53 user nova-compute[74892]: No targets found.
Nov 15 14:25:53 user nova-compute[74892]: iSNS:
Nov 15 14:25:53 user nova-compute[74892]: No targets found.
Nov 15 14:25:53 user nova-compute[74892]: STATIC:
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb
Nov 15 14:25:53 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:25:53 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:25:53 user nova-compute[74892]: FIRMWARE:
Nov 15 14:25:53 user nova-compute[74892]: No targets found.
Nov 15 14:25:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:25:53 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:25:53 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f566bd0-09f4-485a-8031-dad5db6c3c8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1189bc4-1c5e-476c-8807-122bda120ec6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:25:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:25:53 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:25:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20581090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7a7eca-1977-4830-a1fb-6c0552e42300]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeee0f5-fc1e-461e-8614-ff6ba7f7185d]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a88bb4-a7e8-4705-a20f-40e0dfe19908]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d96a6ca-cc1b-45cf-b3ca-8ef9fd5a5a0f]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ec3ef8-d86f-4c14-bd04-e1997f209dec]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4592e1b6-863a-464b-a796-05defa7e8825]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260]
Nov 15 14:25:53 user nova-compute[74892]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc, portal: 172.16.0.220,3260] successful.
Nov 15 14:25:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:523904d1-5ba8-4e20-b5fb-0ae3fdb0e3bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[905ad998-9791-4c8e-9170-6a645ed1396b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== disconnect_volume: return (391ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:25:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:25:54 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'flavor' on Instance uuid 726e0f64-5808-4e5b-accf-190ed1537b44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:25:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ea617068-c37b-43d2-b6d0-0798ce0562ea tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.161s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-f08733f4-5fea-42c7-8c61-465d7e36c1de req-e1c5f8b3-2259-4e6a-8455-1d3db3c05633 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:25:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f08733f4-5fea-42c7-8c61-465d7e36c1de req-e1c5f8b3-2259-4e6a-8455-1d3db3c05633 service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:25:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f08733f4-5fea-42c7-8c61-465d7e36c1de req-e1c5f8b3-2259-4e6a-8455-1d3db3c05633 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:25:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f08733f4-5fea-42c7-8c61-465d7e36c1de req-e1c5f8b3-2259-4e6a-8455-1d3db3c05633 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:25:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-f08733f4-5fea-42c7-8c61-465d7e36c1de req-e1c5f8b3-2259-4e6a-8455-1d3db3c05633 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:25:55 user nova-compute[74892]: WARNING nova.compute.manager [req-f08733f4-5fea-42c7-8c61-465d7e36c1de req-e1c5f8b3-2259-4e6a-8455-1d3db3c05633 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state active and task_state rescuing.
Nov 15 14:25:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c5e7428f-e1a0-4ba6-9df8-3f086b536b01 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:25:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:25:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-c14ac9b5-9cc5-4a41-9b7f-6b86fcb3354d req-b677d950-b68c-40ca-a214-44f67bc9cdca service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-changed-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-c14ac9b5-9cc5-4a41-9b7f-6b86fcb3354d req-b677d950-b68c-40ca-a214-44f67bc9cdca service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Refreshing instance network info cache due to event network-changed-995f76ef-0e34-4c72-8c67-ff575231e6cf. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:26:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c14ac9b5-9cc5-4a41-9b7f-6b86fcb3354d req-b677d950-b68c-40ca-a214-44f67bc9cdca service nova] Acquiring lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c14ac9b5-9cc5-4a41-9b7f-6b86fcb3354d req-b677d950-b68c-40ca-a214-44f67bc9cdca service nova] Acquired lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-c14ac9b5-9cc5-4a41-9b7f-6b86fcb3354d req-b677d950-b68c-40ca-a214-44f67bc9cdca service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Refreshing network info cache for port 995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:26:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-c14ac9b5-9cc5-4a41-9b7f-6b86fcb3354d req-b677d950-b68c-40ca-a214-44f67bc9cdca service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updated VIF entry in instance network info cache for port 995f76ef-0e34-4c72-8c67-ff575231e6cf. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:26:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-c14ac9b5-9cc5-4a41-9b7f-6b86fcb3354d req-b677d950-b68c-40ca-a214-44f67bc9cdca service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating instance_info_cache with network_info: [{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c14ac9b5-9cc5-4a41-9b7f-6b86fcb3354d req-b677d950-b68c-40ca-a214-44f67bc9cdca service nova] Releasing lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:09 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae627049-158a-4e50-9e9b-29fc7992345d is timed out.
Nov 15 14:26:09 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Successfully detached device vdb from instance ae627049-158a-4e50-9e9b-29fc7992345d from the live domain config.
Nov 15 14:26:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMGtiumI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:09 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[496d1274-214e-42d3-9a87-6e940650a32c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:26:09 user nova-compute[74892]: No targets found.
Nov 15 14:26:09 user nova-compute[74892]: iSNS:
Nov 15 14:26:09 user nova-compute[74892]: No targets found.
Nov 15 14:26:09 user nova-compute[74892]: STATIC:
Nov 15 14:26:09 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:26:09 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:09 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:09 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e
Nov 15 14:26:09 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:09 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:09 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:26:09 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:09 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:09 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e
Nov 15 14:26:09 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:09 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:09 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89
Nov 15 14:26:09 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:09 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:09 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:26:09 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:09 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:09 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:26:09 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:09 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:09 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb
Nov 15 14:26:09 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:09 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:09 user nova-compute[74892]: FIRMWARE:
Nov 15 14:26:09 user nova-compute[74892]: No targets found.
Nov 15 14:26:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:26:09 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:26:09 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa91c55-e2bf-4f30-a53b-5782b035dfa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f35b3dc-927b-444d-a5a2-904cdf48edb7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e (non-flash)
Nov 15 14:26:09 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd004037f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e'): ({'sdj'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Removing single pathed devices sdj {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[725dd73d-4ab0-4756-b3de-eaaccef99a8d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[370f3bad-ca87-469d-b3fd-b3709c86285a]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Flushing IO for device /dev/sdj {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[10abe825-4846-4781-89f4-f535201c1e8a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:26:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.042s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[370a857e-e58e-4a9c-b11e-9e8d3488b09a]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] SCSI volumes sdj have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab78cf5-c2ac-4365-a3ff-806f246f4090]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1a94b6-6126-4fce-b8f3-35f716574e19]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e, portal: 172.16.0.220,3260]
Nov 15 14:26:10 user nova-compute[74892]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e, portal: 172.16.0.220,3260] successful.
Nov 15 14:26:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[31be31ec-e452-4672-b036-ac38b5732ca8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] <== disconnect_volume: return (357ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:26:10 user nova-compute[74892]: DEBUG nova.objects.instance [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'flavor' on Instance uuid ae627049-158a-4e50-9e9b-29fc7992345d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7cd2b9ae-907e-4778-b78e-5fc115bf21a1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.448s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.333s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:11 user nova-compute[74892]: INFO nova.compute.manager [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Shelving
Nov 15 14:26:11 user nova-compute[74892]: INFO nova.compute.manager [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Terminating instance
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-8bed439d-70ce-4731-8a0f-ac299c253280 req-bf23a250-c56f-4914-9ccf-0adc04eb41d0 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-unplugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8bed439d-70ce-4731-8a0f-ac299c253280 req-bf23a250-c56f-4914-9ccf-0adc04eb41d0 service nova] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8bed439d-70ce-4731-8a0f-ac299c253280 req-bf23a250-c56f-4914-9ccf-0adc04eb41d0 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8bed439d-70ce-4731-8a0f-ac299c253280 req-bf23a250-c56f-4914-9ccf-0adc04eb41d0 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-8bed439d-70ce-4731-8a0f-ac299c253280 req-bf23a250-c56f-4914-9ccf-0adc04eb41d0 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] No waiting events found dispatching network-vif-unplugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:11 user nova-compute[74892]: WARNING nova.compute.manager [req-8bed439d-70ce-4731-8a0f-ac299c253280 req-bf23a250-c56f-4914-9ccf-0adc04eb41d0 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received unexpected event network-vif-unplugged-995f76ef-0e34-4c72-8c67-ff575231e6cf for instance with vm_state active and task_state shelving.
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-81515eca-1fbb-4bf7-a041-6e275fd298b4 req-c6a24b9d-167b-478a-b547-faa7195d301f service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-changed-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-81515eca-1fbb-4bf7-a041-6e275fd298b4 req-c6a24b9d-167b-478a-b547-faa7195d301f service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing instance network info cache due to event network-changed-1db44052-9866-4228-b68c-71236be24436. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-81515eca-1fbb-4bf7-a041-6e275fd298b4 req-c6a24b9d-167b-478a-b547-faa7195d301f service nova] Acquiring lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-81515eca-1fbb-4bf7-a041-6e275fd298b4 req-c6a24b9d-167b-478a-b547-faa7195d301f service nova] Acquired lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.network.neutron [req-81515eca-1fbb-4bf7-a041-6e275fd298b4 req-c6a24b9d-167b-478a-b547-faa7195d301f service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Refreshing network info cache for port 1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-03023ce1-36c2-470f-b13a-b593d1c76c30 req-5182b78c-60f5-434b-a66a-8a51c414462f service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-unplugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-03023ce1-36c2-470f-b13a-b593d1c76c30 req-5182b78c-60f5-434b-a66a-8a51c414462f service nova] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-03023ce1-36c2-470f-b13a-b593d1c76c30 req-5182b78c-60f5-434b-a66a-8a51c414462f service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-03023ce1-36c2-470f-b13a-b593d1c76c30 req-5182b78c-60f5-434b-a66a-8a51c414462f service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-03023ce1-36c2-470f-b13a-b593d1c76c30 req-5182b78c-60f5-434b-a66a-8a51c414462f service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] No waiting events found dispatching network-vif-unplugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-03023ce1-36c2-470f-b13a-b593d1c76c30 req-5182b78c-60f5-434b-a66a-8a51c414462f service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-unplugged-f43c2ae9-479a-4103-b661-c3a715ff9540 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Instance destroyed successfully.
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'resources' on Instance uuid ae627049-158a-4e50-9e9b-29fc7992345d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:23:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1549144006',display_name='tempest-VolumesSnapshotTestJSON-instance-1549144006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1549144006',id=23,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJVfW938uBmsVGRkqe4ysEMCGGxEA2U5UW4qhYcnoFpBxjiySDRZbfwc6EH1F31UATWsnpFg+2DhWPc07beCAwMRPS/PGC9OHAwKauf8kakX0EjxPZxWX/U+CbeGa6wBw==',key_name='tempest-keypair-91959674',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f5a1be2c05744b98fb9c6f7176c2da2',ramdisk_id='',reservation_id='r-bsnlncdp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1165101863',owner_user_name='tempest-VolumesSnapshotTestJSON-1165101863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6bb6050e1514d048c7bf60d2a45a8e9',uuid=ae627049-158a-4e50-9e9b-29fc7992345d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converting VIF {"id": "f43c2ae9-479a-4103-b661-c3a715ff9540", "address": "fa:16:3e:36:c6:df", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf43c2ae9-47", "ovs_interfaceid": "f43c2ae9-479a-4103-b661-c3a715ff9540", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=f43c2ae9-479a-4103-b661-c3a715ff9540,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43c2ae9-47') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_vif [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=f43c2ae9-479a-4103-b661-c3a715ff9540,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43c2ae9-47') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf43c2ae9-47, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance destroyed successfully.
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f55e0d9-6c3e-42f9-b904-7ee79e8f0cac) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: INFO os_vif [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:c6:df,bridge_name='br-int',has_traffic_filtering=True,id=f43c2ae9-479a-4103-b661-c3a715ff9540,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf43c2ae9-47')
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZMGtiumI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:12 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2443a0a9-f959-4a78-9614-abe43b78482b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:26:12 user nova-compute[74892]: No targets found.
Nov 15 14:26:12 user nova-compute[74892]: iSNS:
Nov 15 14:26:12 user nova-compute[74892]: No targets found.
Nov 15 14:26:12 user nova-compute[74892]: STATIC:
Nov 15 14:26:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:26:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e
Nov 15 14:26:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:26:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89
Nov 15 14:26:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:26:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:26:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb
Nov 15 14:26:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:12 user nova-compute[74892]: FIRMWARE:
Nov 15 14:26:12 user nova-compute[74892]: No targets found.
Nov 15 14:26:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:26:12 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:26:12 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7edc0ee-f3a3-4088-adef-9b801599163e', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:26:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Beginning cold snapshot process
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[21095ccb-a1a5-413c-ae87-80fa63fd6224]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b239b-570b-4cc5-84b7-6a210476cad5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:12 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00601240>, {}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Disconnecting from: [] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.108s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] <== disconnect_volume: return (110ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:26:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Deleting instance files /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d_del
Nov 15 14:26:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Deletion of /opt/stack/data/nova/instances/ae627049-158a-4e50-9e9b-29fc7992345d_del complete
Nov 15 14:26:12 user nova-compute[74892]: INFO nova.compute.manager [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk /opt/stack/data/nova/instances/snapshots/tmpr83lbblx/ff2167be8a3043dc9e8983840ed79848 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.network.neutron [req-81515eca-1fbb-4bf7-a041-6e275fd298b4 req-c6a24b9d-167b-478a-b547-faa7195d301f service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updated VIF entry in instance network info cache for port 1db44052-9866-4228-b68c-71236be24436. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:26:12 user nova-compute[74892]: DEBUG nova.network.neutron [req-81515eca-1fbb-4bf7-a041-6e275fd298b4 req-c6a24b9d-167b-478a-b547-faa7195d301f service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [{"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-81515eca-1fbb-4bf7-a041-6e275fd298b4 req-c6a24b9d-167b-478a-b547-faa7195d301f service nova] Releasing lock "refresh_cache-1737a0c1-61e0-44ff-b172-90b9e758781b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk /opt/stack/data/nova/instances/snapshots/tmpr83lbblx/ff2167be8a3043dc9e8983840ed79848" returned: 0 in 0.530s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:13 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Snapshot extracted, beginning image upload
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-9d751c07-39f2-47a4-aaab-149e0d60cbb7 req-b0fe5793-ba6f-4d60-84eb-0cec56920403 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9d751c07-39f2-47a4-aaab-149e0d60cbb7 req-b0fe5793-ba6f-4d60-84eb-0cec56920403 service nova] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9d751c07-39f2-47a4-aaab-149e0d60cbb7 req-b0fe5793-ba6f-4d60-84eb-0cec56920403 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9d751c07-39f2-47a4-aaab-149e0d60cbb7 req-b0fe5793-ba6f-4d60-84eb-0cec56920403 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-9d751c07-39f2-47a4-aaab-149e0d60cbb7 req-b0fe5793-ba6f-4d60-84eb-0cec56920403 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] No waiting events found dispatching network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:13 user nova-compute[74892]: WARNING nova.compute.manager [req-9d751c07-39f2-47a4-aaab-149e0d60cbb7 req-b0fe5793-ba6f-4d60-84eb-0cec56920403 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received unexpected event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] No waiting events found dispatching network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:13 user nova-compute[74892]: WARNING nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received unexpected event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 for instance with vm_state active and task_state deleting.
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] No waiting events found dispatching network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:13 user nova-compute[74892]: WARNING nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received unexpected event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 for instance with vm_state active and task_state deleting.
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] No waiting events found dispatching network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:13 user nova-compute[74892]: WARNING nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received unexpected event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 for instance with vm_state active and task_state deleting.
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-unplugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] No waiting events found dispatching network-vif-unplugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-unplugged-f43c2ae9-479a-4103-b661-c3a715ff9540 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Acquiring lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Lock "ae627049-158a-4e50-9e9b-29fc7992345d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] No waiting events found dispatching network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:13 user nova-compute[74892]: WARNING nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received unexpected event network-vif-plugged-f43c2ae9-479a-4103-b661-c3a715ff9540 for instance with vm_state active and task_state deleting.
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received event network-changed-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Refreshing instance network info cache due to event network-changed-8f1d081b-0a62-4834-9ed1-73cd8ee606da. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Acquiring lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Acquired lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Refreshing network info cache for port 8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:26:14 user nova-compute[74892]: DEBUG nova.network.neutron [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Updated VIF entry in instance network info cache for port 8f1d081b-0a62-4834-9ed1-73cd8ee606da. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:26:14 user nova-compute[74892]: DEBUG nova.network.neutron [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Updating instance_info_cache with network_info: [{"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d6128255-495a-4679-b937-a5904f49ca45 req-26288ff1-7403-4e40-997e-fee492567ebc service nova] Releasing lock "refresh_cache-cdc6d784-d785-48bf-8f3e-30422c4ef9d3" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:14 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-4581797c-ad90-4df1-827f-6e9efd8445a6 req-35574690-7317-4628-830a-010256bb97fe service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Received event network-vif-deleted-f43c2ae9-479a-4103-b661-c3a715ff9540 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:14 user nova-compute[74892]: INFO nova.compute.manager [req-4581797c-ad90-4df1-827f-6e9efd8445a6 req-35574690-7317-4628-830a-010256bb97fe service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Neutron deleted interface f43c2ae9-479a-4103-b661-c3a715ff9540; detaching it from the instance and deleting it from the info cache
Nov 15 14:26:14 user nova-compute[74892]: DEBUG nova.network.neutron [req-4581797c-ad90-4df1-827f-6e9efd8445a6 req-35574690-7317-4628-830a-010256bb97fe service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:14 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Took 2.22 seconds to deallocate network for instance.
Nov 15 14:26:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-4581797c-ad90-4df1-827f-6e9efd8445a6 req-35574690-7317-4628-830a-010256bb97fe service nova] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Detach interface failed, port_id=f43c2ae9-479a-4103-b661-c3a715ff9540, reason: Instance ae627049-158a-4e50-9e9b-29fc7992345d could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:26:14 user nova-compute[74892]: WARNING nova.volume.cinder [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Attachment 476c4829-0a82-4ecb-af04-42af05b08be6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 476c4829-0a82-4ecb-af04-42af05b08be6. (HTTP 404) (Request-ID: req-1fe91e63-0c59-4e9c-9f38-4f366129ab0e)
Nov 15 14:26:14 user nova-compute[74892]: INFO nova.compute.manager [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: ae627049-158a-4e50-9e9b-29fc7992345d] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 14:26:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:15 user nova-compute[74892]: INFO nova.compute.manager [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Terminating instance
Nov 15 14:26:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:15 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Deleted allocations for instance ae627049-158a-4e50-9e9b-29fc7992345d
Nov 15 14:26:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6e75b172-69ab-45c9-90d3-2c5c0e22621f tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "ae627049-158a-4e50-9e9b-29fc7992345d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.777s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lazy-loading 'flavor' on Instance uuid cdc6d784-d785-48bf-8f3e-30422c4ef9d3 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-e85516b0-da2b-4427-8ad3-20df3cf665a3 req-448f39d8-dc40-49f2-b679-3cc22a37533a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e85516b0-da2b-4427-8ad3-20df3cf665a3 req-448f39d8-dc40-49f2-b679-3cc22a37533a service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e85516b0-da2b-4427-8ad3-20df3cf665a3 req-448f39d8-dc40-49f2-b679-3cc22a37533a service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e85516b0-da2b-4427-8ad3-20df3cf665a3 req-448f39d8-dc40-49f2-b679-3cc22a37533a service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-e85516b0-da2b-4427-8ad3-20df3cf665a3 req-448f39d8-dc40-49f2-b679-3cc22a37533a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-unplugged-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-e85516b0-da2b-4427-8ad3-20df3cf665a3 req-448f39d8-dc40-49f2-b679-3cc22a37533a service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-78f7e8d5-667d-4399-a36a-b1eeac685846 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Snapshot image upload complete
Nov 15 14:26:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: INFO nova.compute.manager [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Shelve offloading
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:16 user nova-compute[74892]: INFO nova.compute.manager [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Attaching volume cdac995e-4aa1-4365-a1e4-4697f6e061f2 to /dev/vdb
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance destroyed successfully.
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquired lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG os_brick.utils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d88d493-72ff-4e3c-8cdf-2705ede823b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[806d7fa6-c750-444f-b97c-d3564a7aa725]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[460bc57b-905f-4270-bc77-3a9732ea01b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0882f38-6e5a-4b4b-920d-bf6b2d6d4de0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:26:16 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9819d36b-027b-49ac-82ec-9bd334733040]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG os_brick.utils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Updating existing volume attachment record: 3553ff46-322d-4ba1-b3c3-e7466fc97922 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-unplugged-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-1db44052-9866-4228-b68c-71236be24436 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:16 user nova-compute[74892]: WARNING nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-1db44052-9866-4228-b68c-71236be24436 for instance with vm_state active and task_state deleting.
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-unplugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-43d1762e-37fb-44a0-a87a-4aa3940a9128 req-59631c5b-9483-4e47-96eb-d40a45a4b33d service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating instance_info_cache with network_info: [{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Releasing lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Instance destroyed successfully.
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.objects.instance [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lazy-loading 'resources' on Instance uuid 1737a0c1-61e0-44ff-b172-90b9e758781b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:00:2c,bridge_name='br-int',has_traffic_filtering=True,id=1db44052-9866-4228-b68c-71236be24436,network=Network(fef43699-f31e-40e8-b3fe-26b0082d6662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db44052-98') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:00:2c,bridge_name='br-int',has_traffic_filtering=True,id=1db44052-9866-4228-b68c-71236be24436,network=Network(fef43699-f31e-40e8-b3fe-26b0082d6662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db44052-98') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1db44052-98, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95108005-35e7-4fee-857d-d2523e885b7f) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: INFO os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:00:2c,bridge_name='br-int',has_traffic_filtering=True,id=1db44052-9866-4228-b68c-71236be24436,network=Network(fef43699-f31e-40e8-b3fe-26b0082d6662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db44052-98')
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:d8,bridge_name='br-int',has_traffic_filtering=True,id=03b5d706-f9ed-4605-95dd-fa93deaa2742,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03b5d706-f9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:d8,bridge_name='br-int',has_traffic_filtering=True,id=03b5d706-f9ed-4605-95dd-fa93deaa2742,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03b5d706-f9') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03b5d706-f9, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56b5423a-79fc-4a33-9bec-b8e0f5490037) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: INFO os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2d:d8,bridge_name='br-int',has_traffic_filtering=True,id=03b5d706-f9ed-4605-95dd-fa93deaa2742,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03b5d706-f9')
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:69:92,bridge_name='br-int',has_traffic_filtering=True,id=78f7e8d5-667d-4399-a36a-b1eeac685846,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78f7e8d5-66') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:69:92,bridge_name='br-int',has_traffic_filtering=True,id=78f7e8d5-667d-4399-a36a-b1eeac685846,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78f7e8d5-66') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78f7e8d5-66, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed62f98f-c3bd-487a-93b2-0d4048564806) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: INFO os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:69:92,bridge_name='br-int',has_traffic_filtering=True,id=78f7e8d5-667d-4399-a36a-b1eeac685846,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap78f7e8d5-66')
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a6:42,bridge_name='br-int',has_traffic_filtering=True,id=0d10b0f5-952a-4549-8896-67427a234ad1,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d10b0f5-95') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a6:42,bridge_name='br-int',has_traffic_filtering=True,id=0d10b0f5-952a-4549-8896-67427a234ad1,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d10b0f5-95') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d10b0f5-95, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62ae9bfe-1c2d-4709-a844-b914b58f6c83) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: INFO os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a6:42,bridge_name='br-int',has_traffic_filtering=True,id=0d10b0f5-952a-4549-8896-67427a234ad1,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d10b0f5-95')
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "2d458620-2125-4585-b59d-eb87c8d853dd", "address": "fa:16:3e:b9:62:7d", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d458620-21", "ovs_interfaceid": "2d458620-2125-4585-b59d-eb87c8d853dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=2d458620-2125-4585-b59d-eb87c8d853dd,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d458620-21') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=2d458620-2125-4585-b59d-eb87c8d853dd,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d458620-21') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d458620-21, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-3d238df5-0673-4d88-ab13-f05322975c9b req-4f3508d0-cf35-43b9-a403-9ec7c35a273c service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3d238df5-0673-4d88-ab13-f05322975c9b req-4f3508d0-cf35-43b9-a403-9ec7c35a273c service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3d238df5-0673-4d88-ab13-f05322975c9b req-4f3508d0-cf35-43b9-a403-9ec7c35a273c service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3d238df5-0673-4d88-ab13-f05322975c9b req-4f3508d0-cf35-43b9-a403-9ec7c35a273c service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-3d238df5-0673-4d88-ab13-f05322975c9b req-4f3508d0-cf35-43b9-a403-9ec7c35a273c service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-unplugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-3d238df5-0673-4d88-ab13-f05322975c9b req-4f3508d0-cf35-43b9-a403-9ec7c35a273c service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58ac8d32-a332-4d7b-ab8b-59beac91c2ef) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:18 user nova-compute[74892]: WARNING nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-78f7e8d5-667d-4399-a36a-b1eeac685846 for instance with vm_state active and task_state deleting.
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-unplugged-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-0d10b0f5-952a-4549-8896-67427a234ad1 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:18 user nova-compute[74892]: WARNING nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-0d10b0f5-952a-4549-8896-67427a234ad1 for instance with vm_state active and task_state deleting.
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-unplugged-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-24be016a-8d51-4687-9a52-78be7a2d537e for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:18 user nova-compute[74892]: WARNING nova.compute.manager [req-5cf5e49c-7789-4937-923e-0ff400a4b3d6 req-dd329d57-d23e-472e-924c-47d35988966b service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-24be016a-8d51-4687-9a52-78be7a2d537e for instance with vm_state active and task_state deleting.
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: INFO os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:62:7d,bridge_name='br-int',has_traffic_filtering=True,id=2d458620-2125-4585-b59d-eb87c8d853dd,network=Network(01c80727-6f0f-4bba-9e25-ae5e622c9d74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d458620-21')
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=24be016a-8d51-4687-9a52-78be7a2d537e,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be016a-8d') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=24be016a-8d51-4687-9a52-78be7a2d537e,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be016a-8d') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24be016a-8d, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3339f15a-f56d-477e-9bb6-a44f80c255b5) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: INFO os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6f:fc,bridge_name='br-int',has_traffic_filtering=True,id=24be016a-8d51-4687-9a52-78be7a2d537e,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24be016a-8d')
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T14:24:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1352376590',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1352376590',id=26,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4n9Rx0IlBilFUUaaxsHKsyn2vJKM2u8BRI+mZjaOmqVGGcXDzTLWM5fvXuCEwPfOdtR0RHG2Mr+GrS7l4xG0pssF9/1uT2Py8pU9vD/NX9+gJHO9jDJB8RziiHxKWiyQ==',key_name='tempest-keypair-1132847399',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac1f38c1463544149842279bfc867448',ramdisk_id='',reservation_id='r-vrg8s9dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-446006916',owner_user_name='tempest-TaggedBootDevicesTest-446006916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b194d77741c047219a9af6ae55979554',uuid=1737a0c1-61e0-44ff-b172-90b9e758781b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converting VIF {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:05:73,bridge_name='br-int',has_traffic_filtering=True,id=41c90e2a-e9df-4f39-9d69-7409bfbfefdf,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c90e2a-e9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:05:73,bridge_name='br-int',has_traffic_filtering=True,id=41c90e2a-e9df-4f39-9d69-7409bfbfefdf,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c90e2a-e9') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41c90e2a-e9, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=404012d5-4036-45b1-816f-fb971164676e) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: INFO os_vif [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:05:73,bridge_name='br-int',has_traffic_filtering=True,id=41c90e2a-e9df-4f39-9d69-7409bfbfefdf,network=Network(5791dc12-829c-4dda-b328-ac3a5a699411),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c90e2a-e9')
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBbnWhRu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:18 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4df6620-9370-4229-9901-1cfea9946483]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:26:18 user nova-compute[74892]: No targets found.
Nov 15 14:26:18 user nova-compute[74892]: iSNS:
Nov 15 14:26:18 user nova-compute[74892]: No targets found.
Nov 15 14:26:18 user nova-compute[74892]: STATIC:
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: FIRMWARE:
Nov 15 14:26:18 user nova-compute[74892]: No targets found.
Nov 15 14:26:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:26:18 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:26:18 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f537f7d7-93ee-4029-be67-7d07fdfad876]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[527325f6-32d5-4c20-ba71-ad9f85bee5ff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00617010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb'): ({'sdh'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Removing single pathed devices sdh {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[da18ba1c-0e12-4ce0-b56b-059a2b073f02]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b011015a-26af-454c-a622-c309a047068a]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Flushing IO for device /dev/sdh {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273fe5c-0cf9-4a32-bc65-5db3525c8c3f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ba1082-4b38-4f73-816a-92ae563b50f0]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] SCSI volumes sdh have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6584be1a-a5d1-474c-ac50-c3fcf48ce039]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance destroyed successfully.
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.objects.instance [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'resources' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1209906851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1209906851',id=25,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYIp96BY4njafdkukW1AZeIh/xphqcEZg1lAcfMjYfkkeNZ2xpYDF6tQzcgcn1LtJYbFmWS2WoB3hKNiC+q/N5fNsJpFr6zwpF74auvR/YJYzlAtbH4nxeEJuGrMhGOJg==',key_name='tempest-keypair-1742187766',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ey0qyk5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member',shelved_at='2023-11-15T14:26:15.956436',shelved_host='user',shelved_image_id='d431b08a-c0cf-409c-81a6-cc98988fa4af'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=5267e3dc-3c08-4046-836c-6ac540f0476d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_vif [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap995f76ef-0e, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f4cf553-3740-48c1-a74d-fa9d53720e45) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef0062-2289-4cc4-989b-b0cfd4dbdfae]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb, portal: 172.16.0.220,3260]
Nov 15 14:26:18 user nova-compute[74892]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb, portal: 172.16.0.220,3260] successful.
Nov 15 14:26:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: INFO os_vif [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e')
Nov 15 14:26:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Deleting instance files /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d_del
Nov 15 14:26:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Deletion of /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d_del complete
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e3c98f-f43b-46c5-88ca-1f2c1bbbb5fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[411687d4-58cc-409b-a769-b83a6801b14e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== disconnect_volume: return (389ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RWLVdhva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:18 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9279da67-24d3-46de-9d6f-42ae6d5cdd1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:26:18 user nova-compute[74892]: No targets found.
Nov 15 14:26:18 user nova-compute[74892]: iSNS:
Nov 15 14:26:18 user nova-compute[74892]: No targets found.
Nov 15 14:26:18 user nova-compute[74892]: STATIC:
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:26:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:18 user nova-compute[74892]: FIRMWARE:
Nov 15 14:26:18 user nova-compute[74892]: No targets found.
Nov 15 14:26:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:26:18 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:26:18 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb77e65-b7a9-4d50-9037-036464a8fa81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Deleted allocations for instance 5267e3dc-3c08-4046-836c-6ac540f0476d
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee4229-7da8-4c00-9a4c-fab4f03ce94e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00615c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89'): ({'sdi'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Removing single pathed devices sdi {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99f9bb3-70bc-4971-88c7-34a468ee2527]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22ad915-fd47-4d6d-b31c-65dd872ff1a2]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Flushing IO for device /dev/sdi {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.objects.instance [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'numa_topology' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:18 user nova-compute[74892]: WARNING nova.compute.manager [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-41c90e2a-e9df-4f39-9d69-7409bfbfefdf for instance with vm_state active and task_state deleting.
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-changed-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Refreshing instance network info cache due to event network-changed-995f76ef-0e34-4c72-8c67-ff575231e6cf. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] Acquiring lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] Acquired lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Refreshing network info cache for port 995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed65ebb-177d-4741-8a54-4187edcadefc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.objects.base [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<5267e3dc-3c08-4046-836c-6ac540f0476d> lazy-loaded attributes: resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeded82-6feb-4811-a872-bb417ec8b6bd]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] SCSI volumes sdi have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5609d090-414e-4ead-8c24-64ca2b2fa0cb]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[948d4f90-2371-4e4b-93e9-2ea2396860c3]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89, portal: 172.16.0.220,3260]
Nov 15 14:26:18 user nova-compute[74892]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89, portal: 172.16.0.220,3260] successful.
Nov 15 14:26:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:631854af-36c0-4c2b-a8a0-1d1bf07dda89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fb6e39-117e-4ac9-a1e9-ce15811e35c4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== disconnect_volume: return (361ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RPXUNDuF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:18 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[488d2a8f-550f-44f3-976f-0388914a6bdb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:26:19 user nova-compute[74892]: No targets found.
Nov 15 14:26:19 user nova-compute[74892]: iSNS:
Nov 15 14:26:19 user nova-compute[74892]: No targets found.
Nov 15 14:26:19 user nova-compute[74892]: STATIC:
Nov 15 14:26:19 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:26:19 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:19 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:19 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e
Nov 15 14:26:19 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:19 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:19 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:26:19 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:19 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:19 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:26:19 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:19 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:19 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:26:19 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:19 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:19 user nova-compute[74892]: FIRMWARE:
Nov 15 14:26:19 user nova-compute[74892]: No targets found.
Nov 15 14:26:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:26:19 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:26:19 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a63446-79a4-484c-b198-6127e974da2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e442bebd-45db-4e0d-8355-c2a2ffef574b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:19 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:19 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:19 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:19 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:19 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:19 user nova-compute[74892]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e (non-flash)
Nov 15 14:26:19 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:19 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2015f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e'): ({'sdg'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Removing single pathed devices sdg {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e9931f-2e1f-408c-9efe-f16c62e5a180]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[10767d6e-cdb0-4539-a995-1ee9bf496051]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Flushing IO for device /dev/sdg {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[653fdd99-3119-4d85-a6f7-ac67a7327e4f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.065s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[179a67bd-9992-455a-9968-07c1a33519b1]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] SCSI volumes sdg have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-800ed43d-03da-4f6d-aa5b-b94570b4bdfa tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.237s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e47f0b-8d8e-48e2-9287-f7b844339559]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa208b5-4313-4918-93e2-b7679ba12ddf]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e, portal: 172.16.0.220,3260]
Nov 15 14:26:19 user nova-compute[74892]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e, portal: 172.16.0.220,3260] successful.
Nov 15 14:26:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updated VIF entry in instance network info cache for port 995f76ef-0e34-4c72-8c67-ff575231e6cf. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating instance_info_cache with network_info: [{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap995f76ef-0e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-bda18785-cc09-4c21-a414-e0adb434002c req-2302802d-433b-4c14-b96f-8f537a4da07f service nova] Releasing lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d89100c3-f947-4c40-b4ff-f67ace62960e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[adceb8ed-5016-43f6-9f38-8ca2f98ba866]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] <== disconnect_volume: return (398ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:26:19 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Deleting instance files /opt/stack/data/nova/instances/1737a0c1-61e0-44ff-b172-90b9e758781b_del
Nov 15 14:26:19 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Deletion of /opt/stack/data/nova/instances/1737a0c1-61e0-44ff-b172-90b9e758781b_del complete
Nov 15 14:26:19 user nova-compute[74892]: INFO nova.compute.manager [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Took 4.28 seconds to destroy the instance on the hypervisor.
Nov 15 14:26:19 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:26:19 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:20 user nova-compute[74892]: WARNING nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-03b5d706-f9ed-4605-95dd-fa93deaa2742 for instance with vm_state active and task_state deleting.
Nov 15 14:26:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-unplugged-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-unplugged-2d458620-2125-4585-b59d-eb87c8d853dd for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Acquiring lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] No waiting events found dispatching network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:20 user nova-compute[74892]: WARNING nova.compute.manager [req-7b60d04e-ce65-4a76-b38f-fa1f2da28163 req-aae55551-2db4-4e40-b2bf-9d60a867c101 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received unexpected event network-vif-plugged-2d458620-2125-4585-b59d-eb87c8d853dd for instance with vm_state active and task_state deleting.
Nov 15 14:26:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-29cea5bd-238d-4ce9-8cb8-24cfe8e8ded4 req-169b02e0-dfe0-42e9-91da-da84a31bb844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-deleted-2d458620-2125-4585-b59d-eb87c8d853dd {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:21 user nova-compute[74892]: INFO nova.compute.manager [req-29cea5bd-238d-4ce9-8cb8-24cfe8e8ded4 req-169b02e0-dfe0-42e9-91da-da84a31bb844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Neutron deleted interface 2d458620-2125-4585-b59d-eb87c8d853dd; detaching it from the instance and deleting it from the info cache
Nov 15 14:26:21 user nova-compute[74892]: DEBUG nova.network.neutron [req-29cea5bd-238d-4ce9-8cb8-24cfe8e8ded4 req-169b02e0-dfe0-42e9-91da-da84a31bb844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [{"id": "1db44052-9866-4228-b68c-71236be24436", "address": "fa:16:3e:f9:00:2c", "network": {"id": "fef43699-f31e-40e8-b3fe-26b0082d6662", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1658951662-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db44052-98", "ovs_interfaceid": "1db44052-9866-4228-b68c-71236be24436", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "address": "fa:16:3e:b3:2d:d8", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03b5d706-f9", "ovs_interfaceid": "03b5d706-f9ed-4605-95dd-fa93deaa2742", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78f7e8d5-667d-4399-a36a-b1eeac685846", "address": "fa:16:3e:99:69:92", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78f7e8d5-66", "ovs_interfaceid": "78f7e8d5-667d-4399-a36a-b1eeac685846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d10b0f5-952a-4549-8896-67427a234ad1", "address": "fa:16:3e:33:a6:42", "network": {"id": "01c80727-6f0f-4bba-9e25-ae5e622c9d74", "bridge": "br-int", "label": "tempest-device-tagging-net1-1348878801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d10b0f5-95", "ovs_interfaceid": "0d10b0f5-952a-4549-8896-67427a234ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "24be016a-8d51-4687-9a52-78be7a2d537e", "address": "fa:16:3e:ef:6f:fc", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24be016a-8d", "ovs_interfaceid": "24be016a-8d51-4687-9a52-78be7a2d537e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "address": "fa:16:3e:89:05:73", "network": {"id": "5791dc12-829c-4dda-b328-ac3a5a699411", "bridge": "br-int", "label": "tempest-device-tagging-net2-1774357486", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ac1f38c1463544149842279bfc867448", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c90e2a-e9", "ovs_interfaceid": "41c90e2a-e9df-4f39-9d69-7409bfbfefdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-29cea5bd-238d-4ce9-8cb8-24cfe8e8ded4 req-169b02e0-dfe0-42e9-91da-da84a31bb844 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Detach interface failed, port_id=2d458620-2125-4585-b59d-eb87c8d853dd, reason: Instance 1737a0c1-61e0-44ff-b172-90b9e758781b could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:26:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:26:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkDbcPVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:21 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:22 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:22 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea97b2e-7578-4f27-856a-11fbce292054]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:26:22 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae3aaef-780f-44ef-80b8-7a87c5b17981]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2] added
Nov 15 14:26:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e1057f-816e-407c-9b7a-6400f6adaba9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[485b8c65-f500-4284-9cc3-14d05a5b1d4c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BkDbcPVX {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BkDbcPVX" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[85195fe7-d268-4153-b287-cbda515149dd]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BkDbcPVX'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c23a4b-ce3c-460d-949e-a49c76285d02]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b1e45-8f49-4d7b-b640-549dddaba378]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0f6d7e-1dc8-4d1a-9609-86f159bebd2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2, portal: 172.16.0.220,3260]
Nov 15 14:26:22 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2, portal: 172.16.0.220,3260] successful.
Nov 15 14:26:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[62443444-27d1-4f5a-b373-5086b89761da]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1177863-23f0-40d6-b687-ef791a8223a0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 (non-flash)
Nov 15 14:26:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebb5294-9a03-4c02-99ac-5ea34683fdec]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkDbcPVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:22 user nova-compute[74892]: INFO nova.compute.manager [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Terminating instance
Nov 15 14:26:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-6fc3bfa7-3cde-47ad-a74a-abfc647dbf3f req-f2d9814b-e668-4d60-bd0b-fcdfeb3c9bcf service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-unplugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6fc3bfa7-3cde-47ad-a74a-abfc647dbf3f req-f2d9814b-e668-4d60-bd0b-fcdfeb3c9bcf service nova] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6fc3bfa7-3cde-47ad-a74a-abfc647dbf3f req-f2d9814b-e668-4d60-bd0b-fcdfeb3c9bcf service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6fc3bfa7-3cde-47ad-a74a-abfc647dbf3f req-f2d9814b-e668-4d60-bd0b-fcdfeb3c9bcf service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-6fc3bfa7-3cde-47ad-a74a-abfc647dbf3f req-f2d9814b-e668-4d60-bd0b-fcdfeb3c9bcf service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] No waiting events found dispatching network-vif-unplugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-6fc3bfa7-3cde-47ad-a74a-abfc647dbf3f req-f2d9814b-e668-4d60-bd0b-fcdfeb3c9bcf service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-unplugged-875aae3f-fa95-4bf3-8790-42171f0f7fac for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26539626137626431', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539626137626431', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lazy-loading 'flavor' on Instance uuid cdc6d784-d785-48bf-8f3e-30422c4ef9d3 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:26:23 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:26:23 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:26:23 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:26:23 user nova-compute[74892]:   <serial>cdac995e-4aa1-4365-a1e4-4697f6e061f2</serial>
Nov 15 14:26:23 user nova-compute[74892]: </disk>
Nov 15 14:26:23 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:23 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:23 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Took 4.13 seconds to deallocate network for instance.
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-47e722a6-5751-41df-8f83-420110605909 req-ae5db571-3819-43de-8448-d7ebe9c86769 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-deleted-24be016a-8d51-4687-9a52-78be7a2d537e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-47e722a6-5751-41df-8f83-420110605909 req-ae5db571-3819-43de-8448-d7ebe9c86769 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-deleted-1db44052-9866-4228-b68c-71236be24436 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-47e722a6-5751-41df-8f83-420110605909 req-ae5db571-3819-43de-8448-d7ebe9c86769 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-deleted-41c90e2a-e9df-4f39-9d69-7409bfbfefdf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-47e722a6-5751-41df-8f83-420110605909 req-ae5db571-3819-43de-8448-d7ebe9c86769 service nova] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Received event network-vif-deleted-0d10b0f5-952a-4549-8896-67427a234ad1 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:24 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Instance destroyed successfully.
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'resources' on Instance uuid 726e0f64-5808-4e5b-accf-190ed1537b44 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:20:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-564451515',display_name='tempest-ServerActionsTestOtherA-server-1272670793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-564451515',id=16,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLslINOZ2Yol005NIBUtitD9XCJI8RmHPHYUS8gMfH34ivLR6lUVp5HyfScCUSAKd+rmzUMD/uj5+fomrFGbop1y6YKyOzsM5Zmm+KMHhghi9NTsel0jkmy7KtNQMxeqjQ==',key_name='tempest-keypair-37804521',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:22:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-720g3l5i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:22:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=726e0f64-5808-4e5b-accf-190ed1537b44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "address": "fa:16:3e:e3:f1:9d", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875aae3f-fa", "ovs_interfaceid": "875aae3f-fa95-4bf3-8790-42171f0f7fac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG os_vif [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap875aae3f-fa, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e177433-62cf-4860-9e5f-0196ad9ab37d) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:24 user nova-compute[74892]: INFO os_vif [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:f1:9d,bridge_name='br-int',has_traffic_filtering=True,id=875aae3f-fa95-4bf3-8790-42171f0f7fac,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875aae3f-fa')
Nov 15 14:26:24 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Deleting instance files /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44_del
Nov 15 14:26:24 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Deletion of /opt/stack/data/nova/instances/726e0f64-5808-4e5b-accf-190ed1537b44_del complete
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] No VIF found with MAC fa:16:3e:c7:62:46, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:26:24 user nova-compute[74892]: INFO nova.compute.manager [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 14:26:24 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:26:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a0e8bcf0-71e7-44e3-af33-6a7e50d07c8a tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.145s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:25 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Took 1.00 seconds to deallocate network for instance.
Nov 15 14:26:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-70b44e1f-18b5-4293-8a99-2c2e7c667d49 req-201d8a35-355c-4209-89c3-1f526fd57c4e service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-70b44e1f-18b5-4293-8a99-2c2e7c667d49 req-201d8a35-355c-4209-89c3-1f526fd57c4e service nova] Acquiring lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-70b44e1f-18b5-4293-8a99-2c2e7c667d49 req-201d8a35-355c-4209-89c3-1f526fd57c4e service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-70b44e1f-18b5-4293-8a99-2c2e7c667d49 req-201d8a35-355c-4209-89c3-1f526fd57c4e service nova] Lock "726e0f64-5808-4e5b-accf-190ed1537b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-70b44e1f-18b5-4293-8a99-2c2e7c667d49 req-201d8a35-355c-4209-89c3-1f526fd57c4e service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] No waiting events found dispatching network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:25 user nova-compute[74892]: WARNING nova.compute.manager [req-70b44e1f-18b5-4293-8a99-2c2e7c667d49 req-201d8a35-355c-4209-89c3-1f526fd57c4e service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received unexpected event network-vif-plugged-875aae3f-fa95-4bf3-8790-42171f0f7fac for instance with vm_state deleted and task_state None.
Nov 15 14:26:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:25 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Deleted allocations for instance 726e0f64-5808-4e5b-accf-190ed1537b44
Nov 15 14:26:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0417612e-e63b-48a8-bf16-26b0cc4a2401 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "726e0f64-5808-4e5b-accf-190ed1537b44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:26 user nova-compute[74892]: INFO nova.compute.manager [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] [instance: 1737a0c1-61e0-44ff-b172-90b9e758781b] Took 2.41 seconds to detach 3 volumes for instance.
Nov 15 14:26:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-41181e0d-89d5-4b88-bb7a-340fec64128d req-bd022a7f-f610-4b1f-bf35-c52d3bd8819d service nova] [instance: 726e0f64-5808-4e5b-accf-190ed1537b44] Received event network-vif-deleted-875aae3f-fa95-4bf3-8790-42171f0f7fac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:26 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Deleted allocations for instance 1737a0c1-61e0-44ff-b172-90b9e758781b
Nov 15 14:26:26 user nova-compute[74892]: INFO nova.compute.manager [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Detaching volume cdac995e-4aa1-4365-a1e4-4697f6e061f2
Nov 15 14:26:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-de0fb3a2-e0cb-4421-a89b-1574a4b09664 tempest-TaggedBootDevicesTest-446006916 tempest-TaggedBootDevicesTest-446006916-project-member] Lock "1737a0c1-61e0-44ff-b172-90b9e758781b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.422s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:26 user nova-compute[74892]: INFO nova.virt.block_device [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Attempting to driver detach volume cdac995e-4aa1-4365-a1e4-4697f6e061f2 from mountpoint /dev/vdb
Nov 15 14:26:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Attempting to detach device vdb from instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:26:26 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:26:26 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:26:26 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:26:26 user nova-compute[74892]:   <serial>cdac995e-4aa1-4365-a1e4-4697f6e061f2</serial>
Nov 15 14:26:26 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:26:26 user nova-compute[74892]: </disk>
Nov 15 14:26:26 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:26:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Successfully detached device vdb from instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 from the persistent domain config.
Nov 15 14:26:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:26:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:26:26 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:26:26 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:26:26 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:26:26 user nova-compute[74892]:   <serial>cdac995e-4aa1-4365-a1e4-4697f6e061f2</serial>
Nov 15 14:26:26 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:26:26 user nova-compute[74892]: </disk>
Nov 15 14:26:26 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:26:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:26:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:26:30 user nova-compute[74892]: INFO nova.compute.claims [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Claim successful on node user
Nov 15 14:26:30 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.network.neutron [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:26:31 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.policy [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f222c367503c4534a9c11a6c6fd86953', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fa953359477469bba26032f601f6043', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:26:31 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Creating image(s)
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "/opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "/opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk 1073741824" returned: 0 in 0.047s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.network.neutron [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Successfully created port: 39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Cannot resize image /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Ensure instance console log exists: /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Successfully updated port: 39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquired lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3e06d7f-5114-44bc-81d1-471db65a4254 req-f5971033-8fd8-4141-a7a9-1ff2924cf2b8 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-changed-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3e06d7f-5114-44bc-81d1-471db65a4254 req-f5971033-8fd8-4141-a7a9-1ff2924cf2b8 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Refreshing instance network info cache due to event network-changed-39ff716a-e25e-481c-b0ef-86fdc490898f. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3e06d7f-5114-44bc-81d1-471db65a4254 req-f5971033-8fd8-4141-a7a9-1ff2924cf2b8 service nova] Acquiring lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Updating instance_info_cache with network_info: [{"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Releasing lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Instance network_info: |[{"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3e06d7f-5114-44bc-81d1-471db65a4254 req-f5971033-8fd8-4141-a7a9-1ff2924cf2b8 service nova] Acquired lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3e06d7f-5114-44bc-81d1-471db65a4254 req-f5971033-8fd8-4141-a7a9-1ff2924cf2b8 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Refreshing network info cache for port 39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Start _get_guest_xml network_info=[{"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:26:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-36177430',display_name='tempest-TestServerVolumeAttachmentScenario-server-36177430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-36177430',id=29,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhjvrPZyXOfninpO/NgNwR7yCvEXPKK+gH+WVw11gIp+fFHuOoYU+y4iozPLH4oCjNtysQOjcpJRPkl60xQl6NejRKAAeWbVvwZpkTxlEr3IXzJ4YQ/K0wsm6Dxx97+lw==',key_name='tempest-keypair-318216603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fa953359477469bba26032f601f6043',ramdisk_id='',reservation_id='r-07ycwb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1848434449',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1848434449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f222c367503c4534a9c11a6c6fd86953',uuid=e9693214-e0c7-45c0-9542-3171b45712b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Converting VIF {"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c2:26,bridge_name='br-int',has_traffic_filtering=True,id=39ff716a-e25e-481c-b0ef-86fdc490898f,network=Network(1fafa239-7b18-402d-be8c-f507184de3b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39ff716a-e2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lazy-loading 'pci_devices' on Instance uuid e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:26:33 user nova-compute[74892]:   <uuid>e9693214-e0c7-45c0-9542-3171b45712b4</uuid>
Nov 15 14:26:33 user nova-compute[74892]:   <name>instance-0000001d</name>
Nov 15 14:26:33 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:26:33 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:26:33 user nova-compute[74892]:   <metadata>
Nov 15 14:26:33 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:26:33 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:26:33 user nova-compute[74892]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-36177430</nova:name>
Nov 15 14:26:33 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:26:33</nova:creationTime>
Nov 15 14:26:33 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:26:33 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:26:33 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:26:33 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:26:33 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:26:33 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:26:33 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:26:33 user nova-compute[74892]:       <nova:owner>
Nov 15 14:26:33 user nova-compute[74892]:         <nova:user uuid="f222c367503c4534a9c11a6c6fd86953">tempest-TestServerVolumeAttachmentScenario-1848434449-project-member</nova:user>
Nov 15 14:26:33 user nova-compute[74892]:         <nova:project uuid="3fa953359477469bba26032f601f6043">tempest-TestServerVolumeAttachmentScenario-1848434449</nova:project>
Nov 15 14:26:33 user nova-compute[74892]:       </nova:owner>
Nov 15 14:26:33 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:26:33 user nova-compute[74892]:       <nova:ports>
Nov 15 14:26:33 user nova-compute[74892]:         <nova:port uuid="39ff716a-e25e-481c-b0ef-86fdc490898f">
Nov 15 14:26:33 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:26:33 user nova-compute[74892]:         </nova:port>
Nov 15 14:26:33 user nova-compute[74892]:       </nova:ports>
Nov 15 14:26:33 user nova-compute[74892]:     </nova:instance>
Nov 15 14:26:33 user nova-compute[74892]:   </metadata>
Nov 15 14:26:33 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:26:33 user nova-compute[74892]:     <system>
Nov 15 14:26:33 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:26:33 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:26:33 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:26:33 user nova-compute[74892]:       <entry name="serial">e9693214-e0c7-45c0-9542-3171b45712b4</entry>
Nov 15 14:26:33 user nova-compute[74892]:       <entry name="uuid">e9693214-e0c7-45c0-9542-3171b45712b4</entry>
Nov 15 14:26:33 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:26:33 user nova-compute[74892]:     </system>
Nov 15 14:26:33 user nova-compute[74892]:   </sysinfo>
Nov 15 14:26:33 user nova-compute[74892]:   <os>
Nov 15 14:26:33 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:26:33 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:26:33 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:26:33 user nova-compute[74892]:   </os>
Nov 15 14:26:33 user nova-compute[74892]:   <features>
Nov 15 14:26:33 user nova-compute[74892]:     <acpi/>
Nov 15 14:26:33 user nova-compute[74892]:     <apic/>
Nov 15 14:26:33 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:26:33 user nova-compute[74892]:   </features>
Nov 15 14:26:33 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:26:33 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:26:33 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:26:33 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:26:33 user nova-compute[74892]:   </clock>
Nov 15 14:26:33 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:26:33 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:26:33 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:26:33 user nova-compute[74892]:   </cpu>
Nov 15 14:26:33 user nova-compute[74892]:   <devices>
Nov 15 14:26:33 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:26:33 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:26:33 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk"/>
Nov 15 14:26:33 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:26:33 user nova-compute[74892]:     </disk>
Nov 15 14:26:33 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:26:33 user nova-compute[74892]:       <mac address="fa:16:3e:25:c2:26"/>
Nov 15 14:26:33 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:26:33 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:26:33 user nova-compute[74892]:       <target dev="tap39ff716a-e2"/>
Nov 15 14:26:33 user nova-compute[74892]:     </interface>
Nov 15 14:26:33 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:26:33 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/console.log" append="off"/>
Nov 15 14:26:33 user nova-compute[74892]:     </serial>
Nov 15 14:26:33 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:26:33 user nova-compute[74892]:     <video>
Nov 15 14:26:33 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:26:33 user nova-compute[74892]:     </video>
Nov 15 14:26:33 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:26:33 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:26:33 user nova-compute[74892]:     </rng>
Nov 15 14:26:33 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:26:33 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:26:33 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:26:33 user nova-compute[74892]:     </memballoon>
Nov 15 14:26:33 user nova-compute[74892]:   </devices>
Nov 15 14:26:33 user nova-compute[74892]: </domain>
Nov 15 14:26:33 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-36177430',display_name='tempest-TestServerVolumeAttachmentScenario-server-36177430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-36177430',id=29,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhjvrPZyXOfninpO/NgNwR7yCvEXPKK+gH+WVw11gIp+fFHuOoYU+y4iozPLH4oCjNtysQOjcpJRPkl60xQl6NejRKAAeWbVvwZpkTxlEr3IXzJ4YQ/K0wsm6Dxx97+lw==',key_name='tempest-keypair-318216603',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fa953359477469bba26032f601f6043',ramdisk_id='',reservation_id='r-07ycwb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1848434449',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1848434449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f222c367503c4534a9c11a6c6fd86953',uuid=e9693214-e0c7-45c0-9542-3171b45712b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Converting VIF {"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:c2:26,bridge_name='br-int',has_traffic_filtering=True,id=39ff716a-e25e-481c-b0ef-86fdc490898f,network=Network(1fafa239-7b18-402d-be8c-f507184de3b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39ff716a-e2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG os_vif [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c2:26,bridge_name='br-int',has_traffic_filtering=True,id=39ff716a-e25e-481c-b0ef-86fdc490898f,network=Network(1fafa239-7b18-402d-be8c-f507184de3b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39ff716a-e2') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c162483-202e-53a9-9764-ca492e8fb9d3', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39ff716a-e2, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39ff716a-e2, col_values=(('qos', UUID('d909be67-9fd7-477b-abe5-0f0e7a20f556')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39ff716a-e2, col_values=(('external_ids', {'iface-id': '39ff716a-e25e-481c-b0ef-86fdc490898f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:c2:26', 'vm-uuid': 'e9693214-e0c7-45c0-9542-3171b45712b4'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:33 user nova-compute[74892]: INFO os_vif [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:c2:26,bridge_name='br-int',has_traffic_filtering=True,id=39ff716a-e25e-481c-b0ef-86fdc490898f,network=Network(1fafa239-7b18-402d-be8c-f507184de3b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39ff716a-e2')
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:26:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No VIF found with MAC fa:16:3e:25:c2:26, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3e06d7f-5114-44bc-81d1-471db65a4254 req-f5971033-8fd8-4141-a7a9-1ff2924cf2b8 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Updated VIF entry in instance network info cache for port 39ff716a-e25e-481c-b0ef-86fdc490898f. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3e06d7f-5114-44bc-81d1-471db65a4254 req-f5971033-8fd8-4141-a7a9-1ff2924cf2b8 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Updating instance_info_cache with network_info: [{"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3e06d7f-5114-44bc-81d1-471db65a4254 req-f5971033-8fd8-4141-a7a9-1ff2924cf2b8 service nova] Releasing lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:34 user nova-compute[74892]: INFO nova.compute.manager [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Detaching volume 3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:26:34 user nova-compute[74892]: INFO nova.virt.block_device [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Attempting to driver detach volume 3156fb95-a143-4029-a1a9-c583b5de53dc from mountpoint /dev/vdb
Nov 15 14:26:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Attempting to detach device vdb from instance d013f581-2c2a-4935-98d5-53b0904118ac from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:26:34 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:26:34 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:26:34 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:26:34 user nova-compute[74892]:   <serial>3156fb95-a143-4029-a1a9-c583b5de53dc</serial>
Nov 15 14:26:34 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:26:34 user nova-compute[74892]: </disk>
Nov 15 14:26:34 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:26:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully detached device vdb from instance d013f581-2c2a-4935-98d5-53b0904118ac from the persistent domain config.
Nov 15 14:26:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d013f581-2c2a-4935-98d5-53b0904118ac from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:26:34 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:26:34 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:26:34 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:26:34 user nova-compute[74892]:   <serial>3156fb95-a143-4029-a1a9-c583b5de53dc</serial>
Nov 15 14:26:34 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:26:34 user nova-compute[74892]: </disk>
Nov 15 14:26:34 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-cef0dc3c-623a-45e3-ad00-8355f2053e75 req-bca4f7e7-d668-43ac-a48d-03e8e9a4a37d service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cef0dc3c-623a-45e3-ad00-8355f2053e75 req-bca4f7e7-d668-43ac-a48d-03e8e9a4a37d service nova] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cef0dc3c-623a-45e3-ad00-8355f2053e75 req-bca4f7e7-d668-43ac-a48d-03e8e9a4a37d service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-cef0dc3c-623a-45e3-ad00-8355f2053e75 req-bca4f7e7-d668-43ac-a48d-03e8e9a4a37d service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-cef0dc3c-623a-45e3-ad00-8355f2053e75 req-bca4f7e7-d668-43ac-a48d-03e8e9a4a37d service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] No waiting events found dispatching network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:34 user nova-compute[74892]: WARNING nova.compute.manager [req-cef0dc3c-623a-45e3-ad00-8355f2053e75 req-bca4f7e7-d668-43ac-a48d-03e8e9a4a37d service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received unexpected event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f for instance with vm_state building and task_state spawning.
Nov 15 14:26:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d013f581-2c2a-4935-98d5-53b0904118ac {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:26:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-df490376-775a-413a-a947-97c24ee6d46a req-05e1c61c-d896-48ad-b2e0-8c2faa5dbaf5 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-df490376-775a-413a-a947-97c24ee6d46a req-05e1c61c-d896-48ad-b2e0-8c2faa5dbaf5 service nova] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-df490376-775a-413a-a947-97c24ee6d46a req-05e1c61c-d896-48ad-b2e0-8c2faa5dbaf5 service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-df490376-775a-413a-a947-97c24ee6d46a req-05e1c61c-d896-48ad-b2e0-8c2faa5dbaf5 service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-df490376-775a-413a-a947-97c24ee6d46a req-05e1c61c-d896-48ad-b2e0-8c2faa5dbaf5 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] No waiting events found dispatching network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:37 user nova-compute[74892]: WARNING nova.compute.manager [req-df490376-775a-413a-a947-97c24ee6d46a req-05e1c61c-d896-48ad-b2e0-8c2faa5dbaf5 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received unexpected event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f for instance with vm_state building and task_state spawning.
Nov 15 14:26:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:26:37 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Instance spawned successfully.
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:37 user nova-compute[74892]: INFO nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 15 14:26:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:26:37 user nova-compute[74892]: INFO nova.compute.manager [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Took 6.84 seconds to build instance.
Nov 15 14:26:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11ede668-fcb1-43d2-8fd6-dc84e85ecd3b tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.947s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:40 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:26:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:26:41 user nova-compute[74892]: INFO nova.compute.claims [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Claim successful on node user
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9a85430d-53e3-4181-9588-158654fe008d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:26:42 user nova-compute[74892]: INFO nova.compute.claims [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Claim successful on node user
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.policy [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29fa0ea399dc4bafb5d2926ae76261c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16fe2666f7194df390f9764790c3663d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:26:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Creating image(s)
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.204s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.226s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk 1073741824" returned: 0 in 0.077s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:26:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:26:42 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Successfully created port: 80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.policy [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29fa0ea399dc4bafb5d2926ae76261c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16fe2666f7194df390f9764790c3663d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:26:43 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Creating image(s)
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Cannot resize image /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Ensure instance console log exists: /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.207s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk 1073741824" returned: 0 in 0.100s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Successfully updated port: 80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquired lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-9990eac0-13ba-49f3-a061-ccdb072095ce req-40553983-59da-4b7c-9835-f5c2e34ace00 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-changed-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-9990eac0-13ba-49f3-a061-ccdb072095ce req-40553983-59da-4b7c-9835-f5c2e34ace00 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Refreshing instance network info cache due to event network-changed-80c5a034-82fc-4eb0-8c8e-c5237b599138. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9990eac0-13ba-49f3-a061-ccdb072095ce req-40553983-59da-4b7c-9835-f5c2e34ace00 service nova] Acquiring lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.233s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:26:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Successfully created port: 6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Cannot resize image /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Ensure instance console log exists: /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updating instance_info_cache with network_info: [{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Releasing lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance network_info: |[{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9990eac0-13ba-49f3-a061-ccdb072095ce req-40553983-59da-4b7c-9835-f5c2e34ace00 service nova] Acquired lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-9990eac0-13ba-49f3-a061-ccdb072095ce req-40553983-59da-4b7c-9835-f5c2e34ace00 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Refreshing network info cache for port 80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Start _get_guest_xml network_info=[{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:26:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-768833210',display_name='tempest-ServerRescueNegativeTestJSON-server-768833210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-768833210',id=30,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-yapgak5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:42Z,user_data=None,user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=95ff8c73-db6f-4f15-a42f-83133b4fd7b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:5f:0d,bridge_name='br-int',has_traffic_filtering=True,id=80c5a034-82fc-4eb0-8c8e-c5237b599138,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c5a034-82') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'pci_devices' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:26:44 user nova-compute[74892]:   <uuid>95ff8c73-db6f-4f15-a42f-83133b4fd7b1</uuid>
Nov 15 14:26:44 user nova-compute[74892]:   <name>instance-0000001e</name>
Nov 15 14:26:44 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:26:44 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:26:44 user nova-compute[74892]:   <metadata>
Nov 15 14:26:44 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:26:44 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:26:44 user nova-compute[74892]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-768833210</nova:name>
Nov 15 14:26:44 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:26:44</nova:creationTime>
Nov 15 14:26:44 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:26:44 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:26:44 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:26:44 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:26:44 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:26:44 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:26:44 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:26:44 user nova-compute[74892]:       <nova:owner>
Nov 15 14:26:44 user nova-compute[74892]:         <nova:user uuid="29fa0ea399dc4bafb5d2926ae76261c3">tempest-ServerRescueNegativeTestJSON-454831858-project-member</nova:user>
Nov 15 14:26:44 user nova-compute[74892]:         <nova:project uuid="16fe2666f7194df390f9764790c3663d">tempest-ServerRescueNegativeTestJSON-454831858</nova:project>
Nov 15 14:26:44 user nova-compute[74892]:       </nova:owner>
Nov 15 14:26:44 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:26:44 user nova-compute[74892]:       <nova:ports>
Nov 15 14:26:44 user nova-compute[74892]:         <nova:port uuid="80c5a034-82fc-4eb0-8c8e-c5237b599138">
Nov 15 14:26:44 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:26:44 user nova-compute[74892]:         </nova:port>
Nov 15 14:26:44 user nova-compute[74892]:       </nova:ports>
Nov 15 14:26:44 user nova-compute[74892]:     </nova:instance>
Nov 15 14:26:44 user nova-compute[74892]:   </metadata>
Nov 15 14:26:44 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:26:44 user nova-compute[74892]:     <system>
Nov 15 14:26:44 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:26:44 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:26:44 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:26:44 user nova-compute[74892]:       <entry name="serial">95ff8c73-db6f-4f15-a42f-83133b4fd7b1</entry>
Nov 15 14:26:44 user nova-compute[74892]:       <entry name="uuid">95ff8c73-db6f-4f15-a42f-83133b4fd7b1</entry>
Nov 15 14:26:44 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:26:44 user nova-compute[74892]:     </system>
Nov 15 14:26:44 user nova-compute[74892]:   </sysinfo>
Nov 15 14:26:44 user nova-compute[74892]:   <os>
Nov 15 14:26:44 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:26:44 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:26:44 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:26:44 user nova-compute[74892]:   </os>
Nov 15 14:26:44 user nova-compute[74892]:   <features>
Nov 15 14:26:44 user nova-compute[74892]:     <acpi/>
Nov 15 14:26:44 user nova-compute[74892]:     <apic/>
Nov 15 14:26:44 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:26:44 user nova-compute[74892]:   </features>
Nov 15 14:26:44 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:26:44 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:26:44 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:26:44 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:26:44 user nova-compute[74892]:   </clock>
Nov 15 14:26:44 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:26:44 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:26:44 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:26:44 user nova-compute[74892]:   </cpu>
Nov 15 14:26:44 user nova-compute[74892]:   <devices>
Nov 15 14:26:44 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:26:44 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:26:44 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk"/>
Nov 15 14:26:44 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:26:44 user nova-compute[74892]:     </disk>
Nov 15 14:26:44 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:26:44 user nova-compute[74892]:       <mac address="fa:16:3e:00:5f:0d"/>
Nov 15 14:26:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:26:44 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:26:44 user nova-compute[74892]:       <target dev="tap80c5a034-82"/>
Nov 15 14:26:44 user nova-compute[74892]:     </interface>
Nov 15 14:26:44 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:26:44 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/console.log" append="off"/>
Nov 15 14:26:44 user nova-compute[74892]:     </serial>
Nov 15 14:26:44 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:26:44 user nova-compute[74892]:     <video>
Nov 15 14:26:44 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:26:44 user nova-compute[74892]:     </video>
Nov 15 14:26:44 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:26:44 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:26:44 user nova-compute[74892]:     </rng>
Nov 15 14:26:44 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:26:44 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:26:44 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:26:44 user nova-compute[74892]:     </memballoon>
Nov 15 14:26:44 user nova-compute[74892]:   </devices>
Nov 15 14:26:44 user nova-compute[74892]: </domain>
Nov 15 14:26:44 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-768833210',display_name='tempest-ServerRescueNegativeTestJSON-server-768833210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-768833210',id=30,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-yapgak5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:42Z,user_data=None,user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=95ff8c73-db6f-4f15-a42f-83133b4fd7b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:5f:0d,bridge_name='br-int',has_traffic_filtering=True,id=80c5a034-82fc-4eb0-8c8e-c5237b599138,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c5a034-82') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG os_vif [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:5f:0d,bridge_name='br-int',has_traffic_filtering=True,id=80c5a034-82fc-4eb0-8c8e-c5237b599138,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c5a034-82') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa8c2996-991a-59da-921b-51a6f0461b82', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80c5a034-82, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80c5a034-82, col_values=(('qos', UUID('2810bb66-02eb-4a04-a6c6-cdb5a4dc526a')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80c5a034-82, col_values=(('external_ids', {'iface-id': '80c5a034-82fc-4eb0-8c8e-c5237b599138', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:5f:0d', 'vm-uuid': '95ff8c73-db6f-4f15-a42f-83133b4fd7b1'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:44 user nova-compute[74892]: INFO os_vif [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:5f:0d,bridge_name='br-int',has_traffic_filtering=True,id=80c5a034-82fc-4eb0-8c8e-c5237b599138,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c5a034-82')
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No VIF found with MAC fa:16:3e:00:5f:0d, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Successfully updated port: 6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-9990eac0-13ba-49f3-a061-ccdb072095ce req-40553983-59da-4b7c-9835-f5c2e34ace00 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updated VIF entry in instance network info cache for port 80c5a034-82fc-4eb0-8c8e-c5237b599138. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-9990eac0-13ba-49f3-a061-ccdb072095ce req-40553983-59da-4b7c-9835-f5c2e34ace00 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updating instance_info_cache with network_info: [{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9990eac0-13ba-49f3-a061-ccdb072095ce req-40553983-59da-4b7c-9835-f5c2e34ace00 service nova] Releasing lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquired lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-af0d258f-caac-48be-9786-6487c35f44db req-99379ab1-dec0-49fa-849c-ebb6406a848a service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-changed-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-af0d258f-caac-48be-9786-6487c35f44db req-99379ab1-dec0-49fa-849c-ebb6406a848a service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Refreshing instance network info cache due to event network-changed-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:26:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af0d258f-caac-48be-9786-6487c35f44db req-99379ab1-dec0-49fa-849c-ebb6406a848a service nova] Acquiring lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:26:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 is timed out.
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-4064c66f-8529-4bbe-ac5c-3294bf7b1956 req-fd1ee410-668a-4812-b2fd-cc1b9bb6adb4 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4064c66f-8529-4bbe-ac5c-3294bf7b1956 req-fd1ee410-668a-4812-b2fd-cc1b9bb6adb4 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4064c66f-8529-4bbe-ac5c-3294bf7b1956 req-fd1ee410-668a-4812-b2fd-cc1b9bb6adb4 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4064c66f-8529-4bbe-ac5c-3294bf7b1956 req-fd1ee410-668a-4812-b2fd-cc1b9bb6adb4 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-4064c66f-8529-4bbe-ac5c-3294bf7b1956 req-fd1ee410-668a-4812-b2fd-cc1b9bb6adb4 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:48 user nova-compute[74892]: WARNING nova.compute.manager [req-4064c66f-8529-4bbe-ac5c-3294bf7b1956 req-fd1ee410-668a-4812-b2fd-cc1b9bb6adb4 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state building and task_state spawning.
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-260b68ff-643d-4096-80bb-db3b5503b5dd req-7ccb8fc6-b50d-4742-ba50-41481531821e service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-260b68ff-643d-4096-80bb-db3b5503b5dd req-7ccb8fc6-b50d-4742-ba50-41481531821e service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-260b68ff-643d-4096-80bb-db3b5503b5dd req-7ccb8fc6-b50d-4742-ba50-41481531821e service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-260b68ff-643d-4096-80bb-db3b5503b5dd req-7ccb8fc6-b50d-4742-ba50-41481531821e service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-260b68ff-643d-4096-80bb-db3b5503b5dd req-7ccb8fc6-b50d-4742-ba50-41481531821e service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:48 user nova-compute[74892]: WARNING nova.compute.manager [req-260b68ff-643d-4096-80bb-db3b5503b5dd req-7ccb8fc6-b50d-4742-ba50-41481531821e service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state building and task_state spawning.
Nov 15 14:26:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Successfully detached device vdb from instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 from the live domain config.
Nov 15 14:26:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance spawned successfully.
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BkDbcPVX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:48 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:26:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7704MB free_disk=25.00728988647461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d659396-54e2-44b6-a5d4-586d9f23519b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:26:48 user nova-compute[74892]: No targets found.
Nov 15 14:26:48 user nova-compute[74892]: iSNS:
Nov 15 14:26:48 user nova-compute[74892]: No targets found.
Nov 15 14:26:48 user nova-compute[74892]: STATIC:
Nov 15 14:26:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:26:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:26:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:26:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:26:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2
Nov 15 14:26:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:48 user nova-compute[74892]: FIRMWARE:
Nov 15 14:26:48 user nova-compute[74892]: No targets found.
Nov 15 14:26:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:26:48 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:26:48 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[98da950a-2444-42c0-9069-21d92eaea043]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99385d5-fece-4ca2-b55a-cb889e8549a4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:48 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:48 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:48 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:48 user nova-compute[74892]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 (non-flash)
Nov 15 14:26:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:48 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:48 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:48 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:48 user nova-compute[74892]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 (non-flash)
Nov 15 14:26:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd4031eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afca799-59fa-42ab-9702-d0d58c47ba97]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: INFO nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3810329b-3dee-4298-8df0-f5ca8dc282fa]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d013f581-2c2a-4935-98d5-53b0904118ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9e258725-b58a-46c8-a2f0-099e246564a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e9693214-e0c7-45c0-9542-3171b45712b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9fa1b1-5a03-4c40-80a6-77ca0d4a850c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7427e523-09d6-4d30-a664-3a415f19bed1]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: INFO nova.compute.manager [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Took 7.14 seconds to build instance.
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a36c7b5-1951-4a09-8076-5d65bb83b731]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3f5ea19-049f-4746-bd12-16c2995bcc2a tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.457s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updating instance_info_cache with network_info: [{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[86301b5f-1540-49f2-b339-6155250b51f5]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2, portal: 172.16.0.220,3260]
Nov 15 14:26:48 user nova-compute[74892]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2, portal: 172.16.0.220,3260] successful.
Nov 15 14:26:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Releasing lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Instance network_info: |[{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af0d258f-caac-48be-9786-6487c35f44db req-99379ab1-dec0-49fa-849c-ebb6406a848a service nova] Acquired lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.network.neutron [req-af0d258f-caac-48be-9786-6487c35f44db req-99379ab1-dec0-49fa-849c-ebb6406a848a service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Refreshing network info cache for port 6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Start _get_guest_xml network_info=[{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdac995e-4aa1-4365-a1e4-4697f6e061f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc1e590-d270-45e9-9871-fa7d6e6c7a19]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] <== disconnect_volume: return (394ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:26:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-929193431',display_name='tempest-ServerRescueNegativeTestJSON-server-929193431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-929193431',id=31,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-r2c185fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:43Z,user_data=None,user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=9a85430d-53e3-4181-9588-158654fe008d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:37,bridge_name='br-int',has_traffic_filtering=True,id=6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7d8cf2-83') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.objects.instance [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:26:48 user nova-compute[74892]:   <uuid>9a85430d-53e3-4181-9588-158654fe008d</uuid>
Nov 15 14:26:48 user nova-compute[74892]:   <name>instance-0000001f</name>
Nov 15 14:26:48 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:26:48 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:26:48 user nova-compute[74892]:   <metadata>
Nov 15 14:26:48 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:26:48 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:26:48 user nova-compute[74892]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-929193431</nova:name>
Nov 15 14:26:48 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:26:48</nova:creationTime>
Nov 15 14:26:48 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:26:48 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:26:48 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:26:48 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:26:48 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:26:48 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:26:48 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:26:48 user nova-compute[74892]:       <nova:owner>
Nov 15 14:26:48 user nova-compute[74892]:         <nova:user uuid="29fa0ea399dc4bafb5d2926ae76261c3">tempest-ServerRescueNegativeTestJSON-454831858-project-member</nova:user>
Nov 15 14:26:48 user nova-compute[74892]:         <nova:project uuid="16fe2666f7194df390f9764790c3663d">tempest-ServerRescueNegativeTestJSON-454831858</nova:project>
Nov 15 14:26:48 user nova-compute[74892]:       </nova:owner>
Nov 15 14:26:48 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:26:48 user nova-compute[74892]:       <nova:ports>
Nov 15 14:26:48 user nova-compute[74892]:         <nova:port uuid="6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b">
Nov 15 14:26:48 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 14:26:48 user nova-compute[74892]:         </nova:port>
Nov 15 14:26:48 user nova-compute[74892]:       </nova:ports>
Nov 15 14:26:48 user nova-compute[74892]:     </nova:instance>
Nov 15 14:26:48 user nova-compute[74892]:   </metadata>
Nov 15 14:26:48 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:26:48 user nova-compute[74892]:     <system>
Nov 15 14:26:48 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:26:48 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:26:48 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:26:48 user nova-compute[74892]:       <entry name="serial">9a85430d-53e3-4181-9588-158654fe008d</entry>
Nov 15 14:26:48 user nova-compute[74892]:       <entry name="uuid">9a85430d-53e3-4181-9588-158654fe008d</entry>
Nov 15 14:26:48 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:26:48 user nova-compute[74892]:     </system>
Nov 15 14:26:48 user nova-compute[74892]:   </sysinfo>
Nov 15 14:26:48 user nova-compute[74892]:   <os>
Nov 15 14:26:48 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:26:48 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:26:48 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:26:48 user nova-compute[74892]:   </os>
Nov 15 14:26:48 user nova-compute[74892]:   <features>
Nov 15 14:26:48 user nova-compute[74892]:     <acpi/>
Nov 15 14:26:48 user nova-compute[74892]:     <apic/>
Nov 15 14:26:48 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:26:48 user nova-compute[74892]:   </features>
Nov 15 14:26:48 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:26:48 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:26:48 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:26:48 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:26:48 user nova-compute[74892]:   </clock>
Nov 15 14:26:48 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:26:48 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:26:48 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:26:48 user nova-compute[74892]:   </cpu>
Nov 15 14:26:48 user nova-compute[74892]:   <devices>
Nov 15 14:26:48 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:26:48 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:26:48 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk"/>
Nov 15 14:26:48 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:26:48 user nova-compute[74892]:     </disk>
Nov 15 14:26:48 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:26:48 user nova-compute[74892]:       <mac address="fa:16:3e:74:40:37"/>
Nov 15 14:26:48 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:26:48 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:26:48 user nova-compute[74892]:       <target dev="tap6e7d8cf2-83"/>
Nov 15 14:26:48 user nova-compute[74892]:     </interface>
Nov 15 14:26:48 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:26:48 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/console.log" append="off"/>
Nov 15 14:26:48 user nova-compute[74892]:     </serial>
Nov 15 14:26:48 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:26:48 user nova-compute[74892]:     <video>
Nov 15 14:26:48 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:26:48 user nova-compute[74892]:     </video>
Nov 15 14:26:48 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:26:48 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:26:48 user nova-compute[74892]:     </rng>
Nov 15 14:26:48 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:26:48 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:26:48 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:26:48 user nova-compute[74892]:     </memballoon>
Nov 15 14:26:48 user nova-compute[74892]:   </devices>
Nov 15 14:26:48 user nova-compute[74892]: </domain>
Nov 15 14:26:48 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-929193431',display_name='tempest-ServerRescueNegativeTestJSON-server-929193431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-929193431',id=31,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-r2c185fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:43Z,user_data=None,user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=9a85430d-53e3-4181-9588-158654fe008d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:37,bridge_name='br-int',has_traffic_filtering=True,id=6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7d8cf2-83') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG os_vif [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:37,bridge_name='br-int',has_traffic_filtering=True,id=6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7d8cf2-83') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a705893-0486-5a1f-9f54-e560299531e2', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e7d8cf2-83, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e7d8cf2-83, col_values=(('qos', UUID('58e63465-7d5b-4174-a739-6b7646272ca3')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e7d8cf2-83, col_values=(('external_ids', {'iface-id': '6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:40:37', 'vm-uuid': '9a85430d-53e3-4181-9588-158654fe008d'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:48 user nova-compute[74892]: INFO os_vif [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:40:37,bridge_name='br-int',has_traffic_filtering=True,id=6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7d8cf2-83')
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No VIF found with MAC fa:16:3e:74:40:37, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:26:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:49 user nova-compute[74892]: DEBUG nova.network.neutron [req-af0d258f-caac-48be-9786-6487c35f44db req-99379ab1-dec0-49fa-849c-ebb6406a848a service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updated VIF entry in instance network info cache for port 6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:26:49 user nova-compute[74892]: DEBUG nova.network.neutron [req-af0d258f-caac-48be-9786-6487c35f44db req-99379ab1-dec0-49fa-849c-ebb6406a848a service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updating instance_info_cache with network_info: [{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af0d258f-caac-48be-9786-6487c35f44db req-99379ab1-dec0-49fa-849c-ebb6406a848a service nova] Releasing lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:49 user nova-compute[74892]: DEBUG nova.objects.instance [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lazy-loading 'flavor' on Instance uuid cdc6d784-d785-48bf-8f3e-30422c4ef9d3 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f9b1528c-fbd2-48de-81b0-3f27f72c8feb tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.932s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-a7b212e4-b162-455c-b472-7a69ad1e6412 req-41ddff52-2a42-4bc4-b672-5e5a31cd685c service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7b212e4-b162-455c-b472-7a69ad1e6412 req-41ddff52-2a42-4bc4-b672-5e5a31cd685c service nova] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7b212e4-b162-455c-b472-7a69ad1e6412 req-41ddff52-2a42-4bc4-b672-5e5a31cd685c service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7b212e4-b162-455c-b472-7a69ad1e6412 req-41ddff52-2a42-4bc4-b672-5e5a31cd685c service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-a7b212e4-b162-455c-b472-7a69ad1e6412 req-41ddff52-2a42-4bc4-b672-5e5a31cd685c service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] No waiting events found dispatching network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:50 user nova-compute[74892]: WARNING nova.compute.manager [req-a7b212e4-b162-455c-b472-7a69ad1e6412 req-41ddff52-2a42-4bc4-b672-5e5a31cd685c service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received unexpected event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b for instance with vm_state building and task_state spawning.
Nov 15 14:26:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:51 user nova-compute[74892]: INFO nova.compute.manager [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Detaching volume 817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:26:51 user nova-compute[74892]: INFO nova.virt.block_device [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Attempting to driver detach volume 817f9b79-ad7a-40e2-bcde-9be2b56ae109 from mountpoint /dev/vdb
Nov 15 14:26:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Attempting to detach device vdb from instance 45201330-05c4-4109-99c2-d17761f46add from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:26:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:26:51 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:26:51 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:26:51 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:26:51 user nova-compute[74892]:   <serial>817f9b79-ad7a-40e2-bcde-9be2b56ae109</serial>
Nov 15 14:26:51 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 14:26:51 user nova-compute[74892]: </disk>
Nov 15 14:26:51 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:26:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully detached device vdb from instance 45201330-05c4-4109-99c2-d17761f46add from the persistent domain config.
Nov 15 14:26:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45201330-05c4-4109-99c2-d17761f46add from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:26:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:26:51 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:26:51 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:26:51 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:26:51 user nova-compute[74892]:   <serial>817f9b79-ad7a-40e2-bcde-9be2b56ae109</serial>
Nov 15 14:26:51 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 14:26:51 user nova-compute[74892]: </disk>
Nov 15 14:26:51 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-e2d0a745-0594-4270-836d-74896d9d7ea4 req-03db02e4-b8a1-47d6-b512-77c801b9a9de service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e2d0a745-0594-4270-836d-74896d9d7ea4 req-03db02e4-b8a1-47d6-b512-77c801b9a9de service nova] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e2d0a745-0594-4270-836d-74896d9d7ea4 req-03db02e4-b8a1-47d6-b512-77c801b9a9de service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e2d0a745-0594-4270-836d-74896d9d7ea4 req-03db02e4-b8a1-47d6-b512-77c801b9a9de service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.compute.manager [req-e2d0a745-0594-4270-836d-74896d9d7ea4 req-03db02e4-b8a1-47d6-b512-77c801b9a9de service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] No waiting events found dispatching network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:52 user nova-compute[74892]: WARNING nova.compute.manager [req-e2d0a745-0594-4270-836d-74896d9d7ea4 req-03db02e4-b8a1-47d6-b512-77c801b9a9de service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received unexpected event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b for instance with vm_state building and task_state spawning.
Nov 15 14:26:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:26:52 user nova-compute[74892]: INFO nova.compute.claims [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Claim successful on node user
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:26:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Instance spawned successfully.
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:52 user nova-compute[74892]: INFO nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Took 9.76 seconds to spawn the instance on the hypervisor.
Nov 15 14:26:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:26:52 user nova-compute[74892]: INFO nova.compute.manager [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Took 11.02 seconds to build instance.
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2733ea36-3c8a-4231-8e70-b95bc05648b2 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9a85430d-53e3-4181-9588-158654fe008d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.136s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:26:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.policy [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd6bb6050e1514d048c7bf60d2a45a8e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5a1be2c05744b98fb9c6f7176c2da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:26:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Creating image(s)
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "/opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "/opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "/opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.201s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk 1073741824" returned: 0 in 0.066s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Successfully created port: dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.196s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Checking if we can resize image /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Cannot resize image /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Ensure instance console log exists: /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Successfully updated port: dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquired lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a99be5a-1c9e-43aa-ac86-f2f8a14262e1 req-37120eb4-8134-4357-9875-ac3e16a86681 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received event network-changed-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-9a99be5a-1c9e-43aa-ac86-f2f8a14262e1 req-37120eb4-8134-4357-9875-ac3e16a86681 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Refreshing instance network info cache due to event network-changed-dfc68ead-0105-4466-ba6e-ca32744c0fe8. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a99be5a-1c9e-43aa-ac86-f2f8a14262e1 req-37120eb4-8134-4357-9875-ac3e16a86681 service nova] Acquiring lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Updating instance_info_cache with network_info: [{"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Releasing lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Instance network_info: |[{"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a99be5a-1c9e-43aa-ac86-f2f8a14262e1 req-37120eb4-8134-4357-9875-ac3e16a86681 service nova] Acquired lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-9a99be5a-1c9e-43aa-ac86-f2f8a14262e1 req-37120eb4-8134-4357-9875-ac3e16a86681 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Refreshing network info cache for port dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Start _get_guest_xml network_info=[{"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:26:54 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:54 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-505608388',display_name='tempest-VolumesSnapshotTestJSON-instance-505608388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-505608388',id=32,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlyqyh4WjXXtgmS00Iwxp2IIbVAfdR6Z+rXXwkFLVhzuv/KvC4Vywcl7Iq/s2cgjIIsqUNIQBCGQz2kBqorunVVYTcfbuWZ06U2M1w0EiKtAhXvfl3fgpSuh7pa9mboUw==',key_name='tempest-keypair-1008218788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f5a1be2c05744b98fb9c6f7176c2da2',ramdisk_id='',reservation_id='r-1mktgl66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1165101863',owner_user_name='tempest-VolumesSnapshotTestJSON-1165101863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6bb6050e1514d048c7bf60d2a45a8e9',uuid=532ff00e-4e44-4749-bc09-b5938b073005,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converting VIF {"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:60:43,bridge_name='br-int',has_traffic_filtering=True,id=dfc68ead-0105-4466-ba6e-ca32744c0fe8,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc68ead-01') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'pci_devices' on Instance uuid 532ff00e-4e44-4749-bc09-b5938b073005 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:26:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 45201330-05c4-4109-99c2-d17761f46add] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:26:55 user nova-compute[74892]:   <uuid>532ff00e-4e44-4749-bc09-b5938b073005</uuid>
Nov 15 14:26:55 user nova-compute[74892]:   <name>instance-00000020</name>
Nov 15 14:26:55 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:26:55 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:26:55 user nova-compute[74892]:   <metadata>
Nov 15 14:26:55 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:26:55 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:26:55 user nova-compute[74892]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-505608388</nova:name>
Nov 15 14:26:55 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:26:54</nova:creationTime>
Nov 15 14:26:55 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:26:55 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:26:55 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:26:55 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:26:55 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:26:55 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:26:55 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:26:55 user nova-compute[74892]:       <nova:owner>
Nov 15 14:26:55 user nova-compute[74892]:         <nova:user uuid="d6bb6050e1514d048c7bf60d2a45a8e9">tempest-VolumesSnapshotTestJSON-1165101863-project-member</nova:user>
Nov 15 14:26:55 user nova-compute[74892]:         <nova:project uuid="2f5a1be2c05744b98fb9c6f7176c2da2">tempest-VolumesSnapshotTestJSON-1165101863</nova:project>
Nov 15 14:26:55 user nova-compute[74892]:       </nova:owner>
Nov 15 14:26:55 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:26:55 user nova-compute[74892]:       <nova:ports>
Nov 15 14:26:55 user nova-compute[74892]:         <nova:port uuid="dfc68ead-0105-4466-ba6e-ca32744c0fe8">
Nov 15 14:26:55 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 14:26:55 user nova-compute[74892]:         </nova:port>
Nov 15 14:26:55 user nova-compute[74892]:       </nova:ports>
Nov 15 14:26:55 user nova-compute[74892]:     </nova:instance>
Nov 15 14:26:55 user nova-compute[74892]:   </metadata>
Nov 15 14:26:55 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:26:55 user nova-compute[74892]:     <system>
Nov 15 14:26:55 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:26:55 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:26:55 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:26:55 user nova-compute[74892]:       <entry name="serial">532ff00e-4e44-4749-bc09-b5938b073005</entry>
Nov 15 14:26:55 user nova-compute[74892]:       <entry name="uuid">532ff00e-4e44-4749-bc09-b5938b073005</entry>
Nov 15 14:26:55 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:26:55 user nova-compute[74892]:     </system>
Nov 15 14:26:55 user nova-compute[74892]:   </sysinfo>
Nov 15 14:26:55 user nova-compute[74892]:   <os>
Nov 15 14:26:55 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:26:55 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:26:55 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:26:55 user nova-compute[74892]:   </os>
Nov 15 14:26:55 user nova-compute[74892]:   <features>
Nov 15 14:26:55 user nova-compute[74892]:     <acpi/>
Nov 15 14:26:55 user nova-compute[74892]:     <apic/>
Nov 15 14:26:55 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:26:55 user nova-compute[74892]:   </features>
Nov 15 14:26:55 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:26:55 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:26:55 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:26:55 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:26:55 user nova-compute[74892]:   </clock>
Nov 15 14:26:55 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:26:55 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:26:55 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:26:55 user nova-compute[74892]:   </cpu>
Nov 15 14:26:55 user nova-compute[74892]:   <devices>
Nov 15 14:26:55 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:26:55 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:26:55 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk"/>
Nov 15 14:26:55 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:26:55 user nova-compute[74892]:     </disk>
Nov 15 14:26:55 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:26:55 user nova-compute[74892]:       <mac address="fa:16:3e:6c:60:43"/>
Nov 15 14:26:55 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:26:55 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:26:55 user nova-compute[74892]:       <target dev="tapdfc68ead-01"/>
Nov 15 14:26:55 user nova-compute[74892]:     </interface>
Nov 15 14:26:55 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:26:55 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/console.log" append="off"/>
Nov 15 14:26:55 user nova-compute[74892]:     </serial>
Nov 15 14:26:55 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:26:55 user nova-compute[74892]:     <video>
Nov 15 14:26:55 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:26:55 user nova-compute[74892]:     </video>
Nov 15 14:26:55 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:26:55 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:26:55 user nova-compute[74892]:     </rng>
Nov 15 14:26:55 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:26:55 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:26:55 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:26:55 user nova-compute[74892]:     </memballoon>
Nov 15 14:26:55 user nova-compute[74892]:   </devices>
Nov 15 14:26:55 user nova-compute[74892]: </domain>
Nov 15 14:26:55 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-505608388',display_name='tempest-VolumesSnapshotTestJSON-instance-505608388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-505608388',id=32,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlyqyh4WjXXtgmS00Iwxp2IIbVAfdR6Z+rXXwkFLVhzuv/KvC4Vywcl7Iq/s2cgjIIsqUNIQBCGQz2kBqorunVVYTcfbuWZ06U2M1w0EiKtAhXvfl3fgpSuh7pa9mboUw==',key_name='tempest-keypair-1008218788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f5a1be2c05744b98fb9c6f7176c2da2',ramdisk_id='',reservation_id='r-1mktgl66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1165101863',owner_user_name='tempest-VolumesSnapshotTestJSON-1165101863-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6bb6050e1514d048c7bf60d2a45a8e9',uuid=532ff00e-4e44-4749-bc09-b5938b073005,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converting VIF {"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:60:43,bridge_name='br-int',has_traffic_filtering=True,id=dfc68ead-0105-4466-ba6e-ca32744c0fe8,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc68ead-01') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_vif [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:60:43,bridge_name='br-int',has_traffic_filtering=True,id=dfc68ead-0105-4466-ba6e-ca32744c0fe8,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc68ead-01') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:26:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d013f581-2c2a-4935-98d5-53b0904118ac is timed out.
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c506ce9a-a699-56d0-9594-66c12fac9b9e', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully detached device vdb from instance d013f581-2c2a-4935-98d5-53b0904118ac from the live domain config.
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZaFsxWnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:26:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc68ead-01, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfc68ead-01, col_values=(('qos', UUID('d8bf9905-8bc2-4b83-8ff5-5db543cb350c')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfc68ead-01, col_values=(('external_ids', {'iface-id': 'dfc68ead-0105-4466-ba6e-ca32744c0fe8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:60:43', 'vm-uuid': '532ff00e-4e44-4749-bc09-b5938b073005'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:55 user nova-compute[74892]: INFO os_vif [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:60:43,bridge_name='br-int',has_traffic_filtering=True,id=dfc68ead-0105-4466-ba6e-ca32744c0fe8,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc68ead-01')
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c05c2c2-302e-431b-9fc4-31fb429933b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:26:55 user nova-compute[74892]: No targets found.
Nov 15 14:26:55 user nova-compute[74892]: iSNS:
Nov 15 14:26:55 user nova-compute[74892]: No targets found.
Nov 15 14:26:55 user nova-compute[74892]: STATIC:
Nov 15 14:26:55 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc
Nov 15 14:26:55 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:55 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:55 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:26:55 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:55 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:55 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:26:55 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:55 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:55 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:26:55 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:26:55 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:26:55 user nova-compute[74892]: FIRMWARE:
Nov 15 14:26:55 user nova-compute[74892]: No targets found.
Nov 15 14:26:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:26:55 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:26:55 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[28860d43-5bcd-4180-ad89-cecfab83026a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No VIF found with MAC fa:16:3e:6c:60:43, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e5c059-c655-4f0e-b1d3-b113e518c308]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:55 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:55 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:55 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:26:55 user nova-compute[74892]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc (non-flash)
Nov 15 14:26:55 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:26:55 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:26:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00617760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc'): ({'sdf'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Removing single pathed devices sdf {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cec21f-051d-419c-85d4-1a91d3d194ad]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[566472a4-df0b-41f1-a064-8f3edd0358c3]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flushing IO for device /dev/sdf {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1635ee00-4c5a-48ef-b9bc-890a5bc560da]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.067s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c03bd0-d34a-43c2-a434-e12a5a4457ab]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c6e408-4127-482f-af79-f09bf3b32c0c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[72437e48-2a59-488d-83e1-a80eacde41a9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc, portal: 172.16.0.220,3260]
Nov 15 14:26:55 user nova-compute[74892]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc, portal: 172.16.0.220,3260] successful.
Nov 15 14:26:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3156fb95-a143-4029-a1a9-c583b5de53dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79bf583-5621-4d70-980e-2958934c826c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== disconnect_volume: return (361ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating instance_info_cache with network_info: [{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.network.neutron [req-9a99be5a-1c9e-43aa-ac86-f2f8a14262e1 req-37120eb4-8134-4357-9875-ac3e16a86681 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Updated VIF entry in instance network info cache for port dfc68ead-0105-4466-ba6e-ca32744c0fe8. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.network.neutron [req-9a99be5a-1c9e-43aa-ac86-f2f8a14262e1 req-37120eb4-8134-4357-9875-ac3e16a86681 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Updating instance_info_cache with network_info: [{"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:26:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9a99be5a-1c9e-43aa-ac86-f2f8a14262e1 req-37120eb4-8134-4357-9875-ac3e16a86681 service nova] Releasing lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid d013f581-2c2a-4935-98d5-53b0904118ac {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c5a0b593-4e05-4261-b0ef-96b04adc465f tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.334s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-33d7bc3e-e901-4712-ab8c-a65d415d1ee3 req-73bb893c-4448-4482-91e6-67cd488f0e54 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received event network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33d7bc3e-e901-4712-ab8c-a65d415d1ee3 req-73bb893c-4448-4482-91e6-67cd488f0e54 service nova] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33d7bc3e-e901-4712-ab8c-a65d415d1ee3 req-73bb893c-4448-4482-91e6-67cd488f0e54 service nova] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33d7bc3e-e901-4712-ab8c-a65d415d1ee3 req-73bb893c-4448-4482-91e6-67cd488f0e54 service nova] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-33d7bc3e-e901-4712-ab8c-a65d415d1ee3 req-73bb893c-4448-4482-91e6-67cd488f0e54 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] No waiting events found dispatching network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:56 user nova-compute[74892]: WARNING nova.compute.manager [req-33d7bc3e-e901-4712-ab8c-a65d415d1ee3 req-73bb893c-4448-4482-91e6-67cd488f0e54 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received unexpected event network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 for instance with vm_state building and task_state spawning.
Nov 15 14:26:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:26:58 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Instance spawned successfully.
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-27073d56-c9ff-4891-8fb0-f7a204aff24e req-01040335-8793-4ce5-b628-60724b93502b service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received event network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-27073d56-c9ff-4891-8fb0-f7a204aff24e req-01040335-8793-4ce5-b628-60724b93502b service nova] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-27073d56-c9ff-4891-8fb0-f7a204aff24e req-01040335-8793-4ce5-b628-60724b93502b service nova] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-27073d56-c9ff-4891-8fb0-f7a204aff24e req-01040335-8793-4ce5-b628-60724b93502b service nova] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-27073d56-c9ff-4891-8fb0-f7a204aff24e req-01040335-8793-4ce5-b628-60724b93502b service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] No waiting events found dispatching network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:26:58 user nova-compute[74892]: WARNING nova.compute.manager [req-27073d56-c9ff-4891-8fb0-f7a204aff24e req-01040335-8793-4ce5-b628-60724b93502b service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received unexpected event network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 for instance with vm_state building and task_state spawning.
Nov 15 14:26:58 user nova-compute[74892]: INFO nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 15 14:26:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:26:58 user nova-compute[74892]: INFO nova.compute.manager [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Took 6.28 seconds to build instance.
Nov 15 14:26:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3eb6d200-e167-4fbf-bff7-814bbb5c3c6b tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.404s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:27:05 user nova-compute[74892]: INFO nova.compute.manager [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] instance snapshotting
Nov 15 14:27:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Beginning live snapshot process
Nov 15 14:27:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json -f qcow2 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json -f qcow2 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkmq7218o/58ba9a73d9f6483d86619500c911a1ed.delta 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpkmq7218o/58ba9a73d9f6483d86619500c911a1ed.delta 1073741824" returned: 0 in 0.070s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 14:27:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:27:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] COPY block job progress, current cursor: 26607616 final cursor: 75497472 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:27:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:27:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 14:27:08 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:27:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkmq7218o/58ba9a73d9f6483d86619500c911a1ed.delta /opt/stack/data/nova/instances/snapshots/tmpkmq7218o/58ba9a73d9f6483d86619500c911a1ed {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpkmq7218o/58ba9a73d9f6483d86619500c911a1ed.delta /opt/stack/data/nova/instances/snapshots/tmpkmq7218o/58ba9a73d9f6483d86619500c911a1ed" returned: 0 in 0.711s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:09 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Snapshot extracted, beginning image upload
Nov 15 14:27:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Snapshot image upload complete
Nov 15 14:27:11 user nova-compute[74892]: INFO nova.compute.manager [None req-cd7ec156-9bfa-4044-9092-1b20a9d7d804 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Took 6.25 seconds to snapshot the instance on the hypervisor.
Nov 15 14:27:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45201330-05c4-4109-99c2-d17761f46add is timed out.
Nov 15 14:27:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully detached device vdb from instance 45201330-05c4-4109-99c2-d17761f46add from the live domain config.
Nov 15 14:27:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtqyLdAI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:27:12 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc913891-1b26-4e54-83bb-d73d6057915b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:27:12 user nova-compute[74892]: No targets found.
Nov 15 14:27:12 user nova-compute[74892]: iSNS:
Nov 15 14:27:12 user nova-compute[74892]: No targets found.
Nov 15 14:27:12 user nova-compute[74892]: STATIC:
Nov 15 14:27:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109
Nov 15 14:27:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:27:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:27:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:27:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:27:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:27:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:27:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:27:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:27:12 user nova-compute[74892]: FIRMWARE:
Nov 15 14:27:12 user nova-compute[74892]: No targets found.
Nov 15 14:27:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:27:12 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:27:12 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4c8f81-0019-4ed7-93aa-c81252daf963]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef5175a-34bc-4188-a997-070c3031cd9a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:27:12 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:27:12 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:27:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:27:12 user nova-compute[74892]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 (non-flash)
Nov 15 14:27:12 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:27:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd007c92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8692ec81-a0e8-4def-b0d6-0964af2946d1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35b3e47-d8e5-4096-9f7d-14f7def5f5c4]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f1db0-aca4-43ac-8666-620aaa518989]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a696e3-d781-4356-964e-9e273bd0f5cd]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0484b05f-fbb1-42b5-a351-e5cc7a64927b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e1b404-80ea-4ba9-9ea5-9ccf87756aec]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260]
Nov 15 14:27:12 user nova-compute[74892]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109, portal: 172.16.0.220,3260] successful.
Nov 15 14:27:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:817f9b79-ad7a-40e2-bcde-9be2b56ae109 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.194s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705b358-baca-4e85-9034-b52929790234]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== disconnect_volume: return (480ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:27:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:27:13 user nova-compute[74892]: DEBUG nova.objects.instance [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:27:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e5464240-76fc-4e51-ace5-613ea2c235f1 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.076s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9b1e55-b48b-409d-8fc4-253e6ef8038d tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9b1e55-b48b-409d-8fc4-253e6ef8038d tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0e9b1e55-b48b-409d-8fc4-253e6ef8038d tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0e9b1e55-b48b-409d-8fc4-253e6ef8038d tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74892) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0e9b1e55-b48b-409d-8fc4-253e6ef8038d tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-7f41f8ef-5a6b-44fd-8919-b04230748bfd req-ab88a4df-aa33-434b-bf96-0cffb2cb168b service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7f41f8ef-5a6b-44fd-8919-b04230748bfd req-ab88a4df-aa33-434b-bf96-0cffb2cb168b service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7f41f8ef-5a6b-44fd-8919-b04230748bfd req-ab88a4df-aa33-434b-bf96-0cffb2cb168b service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7f41f8ef-5a6b-44fd-8919-b04230748bfd req-ab88a4df-aa33-434b-bf96-0cffb2cb168b service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-7f41f8ef-5a6b-44fd-8919-b04230748bfd req-ab88a4df-aa33-434b-bf96-0cffb2cb168b service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:14 user nova-compute[74892]: WARNING nova.compute.manager [req-7f41f8ef-5a6b-44fd-8919-b04230748bfd req-ab88a4df-aa33-434b-bf96-0cffb2cb168b service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state active and task_state powering-off.
Nov 15 14:27:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance destroyed successfully.
Nov 15 14:27:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0e9b1e55-b48b-409d-8fc4-253e6ef8038d tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:27:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9b1e55-b48b-409d-8fc4-253e6ef8038d tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-093a6585-059f-4f75-9418-e6ce941621d8 req-83abe6f4-af9e-4054-ac32-aec73520a606 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-093a6585-059f-4f75-9418-e6ce941621d8 req-83abe6f4-af9e-4054-ac32-aec73520a606 service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-093a6585-059f-4f75-9418-e6ce941621d8 req-83abe6f4-af9e-4054-ac32-aec73520a606 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-093a6585-059f-4f75-9418-e6ce941621d8 req-83abe6f4-af9e-4054-ac32-aec73520a606 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-093a6585-059f-4f75-9418-e6ce941621d8 req-83abe6f4-af9e-4054-ac32-aec73520a606 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:16 user nova-compute[74892]: WARNING nova.compute.manager [req-093a6585-059f-4f75-9418-e6ce941621d8 req-83abe6f4-af9e-4054-ac32-aec73520a606 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state stopped and task_state None.
Nov 15 14:27:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:19 user nova-compute[74892]: INFO nova.compute.manager [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Terminating instance
Nov 15 14:27:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-6b74e359-bd9e-42fc-9346-a781db28ac82 req-c15ad3d0-eaf6-459f-8a5f-353d57017691 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received event network-vif-unplugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6b74e359-bd9e-42fc-9346-a781db28ac82 req-c15ad3d0-eaf6-459f-8a5f-353d57017691 service nova] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6b74e359-bd9e-42fc-9346-a781db28ac82 req-c15ad3d0-eaf6-459f-8a5f-353d57017691 service nova] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6b74e359-bd9e-42fc-9346-a781db28ac82 req-c15ad3d0-eaf6-459f-8a5f-353d57017691 service nova] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-6b74e359-bd9e-42fc-9346-a781db28ac82 req-c15ad3d0-eaf6-459f-8a5f-353d57017691 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] No waiting events found dispatching network-vif-unplugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-6b74e359-bd9e-42fc-9346-a781db28ac82 req-c15ad3d0-eaf6-459f-8a5f-353d57017691 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received event network-vif-unplugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:27:19 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Instance destroyed successfully.
Nov 15 14:27:19 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lazy-loading 'resources' on Instance uuid cdc6d784-d785-48bf-8f3e-30422c4ef9d3 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-454557419',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-454557419',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4545574',id=27,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtqEzjmSfLwBCV0N+k4p1l11876Y407Izp4fxQdG62eqz9T1i0bFkj4R4fgYF9D91kI5YQNew6VCfKpFQz/AAu707SGuR7r1QslsrbThWZp/fK1+ncJKfRxf8nTZXRBkw==',key_name='tempest-keypair-1798016923',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36ccd84f99ad45968290ce122b0a4416',ramdisk_id='',reservation_id='r-s9ggvtek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1401517509',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:24:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4ceed2653a4d4f5bb746d404d3b6719c',uuid=cdc6d784-d785-48bf-8f3e-30422c4ef9d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Converting VIF {"id": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "address": "fa:16:3e:c7:62:46", "network": {"id": "ffa83937-532d-450f-9713-b8e392cab267", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1367667199-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36ccd84f99ad45968290ce122b0a4416", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f1d081b-0a", "ovs_interfaceid": "8f1d081b-0a62-4834-9ed1-73cd8ee606da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:62:46,bridge_name='br-int',has_traffic_filtering=True,id=8f1d081b-0a62-4834-9ed1-73cd8ee606da,network=Network(ffa83937-532d-450f-9713-b8e392cab267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1d081b-0a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG os_vif [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:62:46,bridge_name='br-int',has_traffic_filtering=True,id=8f1d081b-0a62-4834-9ed1-73cd8ee606da,network=Network(ffa83937-532d-450f-9713-b8e392cab267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1d081b-0a') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f1d081b-0a, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd21eaf6-c6f0-44c9-9b86-394e76cbe19a) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:27:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:20 user nova-compute[74892]: INFO os_vif [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:62:46,bridge_name='br-int',has_traffic_filtering=True,id=8f1d081b-0a62-4834-9ed1-73cd8ee606da,network=Network(ffa83937-532d-450f-9713-b8e392cab267),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f1d081b-0a')
Nov 15 14:27:20 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Deleting instance files /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3_del
Nov 15 14:27:20 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Deletion of /opt/stack/data/nova/instances/cdc6d784-d785-48bf-8f3e-30422c4ef9d3_del complete
Nov 15 14:27:20 user nova-compute[74892]: INFO nova.compute.manager [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 14:27:20 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:27:20 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:27:20 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:27:20 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:27:21 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Took 0.92 seconds to deallocate network for instance.
Nov 15 14:27:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-87a98cd5-7c56-4d88-bbf0-511bee23731f req-b74a19c2-0275-449c-9e44-da72c1ed0b56 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received event network-vif-deleted-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-d0e5c89b-e67b-400d-a887-a3c96ca6dd02 req-edf96cb6-2e2f-4b9b-a902-ca4a878feb89 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received event network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0e5c89b-e67b-400d-a887-a3c96ca6dd02 req-edf96cb6-2e2f-4b9b-a902-ca4a878feb89 service nova] Acquiring lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0e5c89b-e67b-400d-a887-a3c96ca6dd02 req-edf96cb6-2e2f-4b9b-a902-ca4a878feb89 service nova] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0e5c89b-e67b-400d-a887-a3c96ca6dd02 req-edf96cb6-2e2f-4b9b-a902-ca4a878feb89 service nova] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-d0e5c89b-e67b-400d-a887-a3c96ca6dd02 req-edf96cb6-2e2f-4b9b-a902-ca4a878feb89 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] No waiting events found dispatching network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:21 user nova-compute[74892]: WARNING nova.compute.manager [req-d0e5c89b-e67b-400d-a887-a3c96ca6dd02 req-edf96cb6-2e2f-4b9b-a902-ca4a878feb89 service nova] [instance: cdc6d784-d785-48bf-8f3e-30422c4ef9d3] Received unexpected event network-vif-plugged-8f1d081b-0a62-4834-9ed1-73cd8ee606da for instance with vm_state deleted and task_state None.
Nov 15 14:27:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:27:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.720s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:21 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Deleted allocations for instance cdc6d784-d785-48bf-8f3e-30422c4ef9d3
Nov 15 14:27:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cb42bfb-b6d5-40c7-b019-2931ee4e33ba tempest-TestServerVolumeAttachScenarioOldVersion-1401517509 tempest-TestServerVolumeAttachScenarioOldVersion-1401517509-project-member] Lock "cdc6d784-d785-48bf-8f3e-30422c4ef9d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:24 user nova-compute[74892]: INFO nova.compute.manager [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Terminating instance
Nov 15 14:27:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-b785a239-278d-4c4e-b3b5-1d2faf54e2f0 req-59f71722-0b40-4a17-975f-68c6e7390f0f service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received event network-vif-unplugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b785a239-278d-4c4e-b3b5-1d2faf54e2f0 req-59f71722-0b40-4a17-975f-68c6e7390f0f service nova] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b785a239-278d-4c4e-b3b5-1d2faf54e2f0 req-59f71722-0b40-4a17-975f-68c6e7390f0f service nova] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b785a239-278d-4c4e-b3b5-1d2faf54e2f0 req-59f71722-0b40-4a17-975f-68c6e7390f0f service nova] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-b785a239-278d-4c4e-b3b5-1d2faf54e2f0 req-59f71722-0b40-4a17-975f-68c6e7390f0f service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] No waiting events found dispatching network-vif-unplugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-b785a239-278d-4c4e-b3b5-1d2faf54e2f0 req-59f71722-0b40-4a17-975f-68c6e7390f0f service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received event network-vif-unplugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:27:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:25 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Instance destroyed successfully.
Nov 15 14:27:25 user nova-compute[74892]: DEBUG nova.objects.instance [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'resources' on Instance uuid d013f581-2c2a-4935-98d5-53b0904118ac {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-88780013',display_name='tempest-AttachVolumeNegativeTest-server-88780013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-88780013',id=20,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcgnijwv8Jp5M3JyZq4t7NrTkFyrxrAK6Z6m50/ZI4y77gd9sgNzRuS9Gwww84hJErXN/yL5vfGjFVVNPKYZsP3d3Y3fSGVfGY1uDKDhBJjDqXmyTBbIBI/olwnrNAnUg==',key_name='tempest-keypair-1734118793',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-aw4r6tfk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:21:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=d013f581-2c2a-4935-98d5-53b0904118ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "address": "fa:16:3e:d9:17:f7", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65a4e6c3-62", "ovs_interfaceid": "65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:17:f7,bridge_name='br-int',has_traffic_filtering=True,id=65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a4e6c3-62') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG os_vif [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:17:f7,bridge_name='br-int',has_traffic_filtering=True,id=65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a4e6c3-62') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65a4e6c3-62, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92fd051f-dd2b-4b28-9772-9df35fd167d6) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:25 user nova-compute[74892]: INFO os_vif [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:17:f7,bridge_name='br-int',has_traffic_filtering=True,id=65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65a4e6c3-62')
Nov 15 14:27:25 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Deleting instance files /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac_del
Nov 15 14:27:25 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Deletion of /opt/stack/data/nova/instances/d013f581-2c2a-4935-98d5-53b0904118ac_del complete
Nov 15 14:27:25 user nova-compute[74892]: INFO nova.compute.manager [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 14:27:25 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:27:25 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:27:26 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Took 0.82 seconds to deallocate network for instance.
Nov 15 14:27:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-49d9f589-9cbe-4e51-9039-1922b592e809 req-c81149e9-e00e-4343-9169-0afb1dfd4bfd service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received event network-vif-deleted-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:26 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Deleted allocations for instance d013f581-2c2a-4935-98d5-53b0904118ac
Nov 15 14:27:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-15472f2e-0521-4d57-82e8-eb5bea9bb5a0 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "d013f581-2c2a-4935-98d5-53b0904118ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.244s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-febe0bf0-9d2e-4c96-87f4-f08e37aa7c6c req-be7b545d-1f01-4044-babd-be3693fe5238 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received event network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-febe0bf0-9d2e-4c96-87f4-f08e37aa7c6c req-be7b545d-1f01-4044-babd-be3693fe5238 service nova] Acquiring lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-febe0bf0-9d2e-4c96-87f4-f08e37aa7c6c req-be7b545d-1f01-4044-babd-be3693fe5238 service nova] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-febe0bf0-9d2e-4c96-87f4-f08e37aa7c6c req-be7b545d-1f01-4044-babd-be3693fe5238 service nova] Lock "d013f581-2c2a-4935-98d5-53b0904118ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-febe0bf0-9d2e-4c96-87f4-f08e37aa7c6c req-be7b545d-1f01-4044-babd-be3693fe5238 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] No waiting events found dispatching network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:26 user nova-compute[74892]: WARNING nova.compute.manager [req-febe0bf0-9d2e-4c96-87f4-f08e37aa7c6c req-be7b545d-1f01-4044-babd-be3693fe5238 service nova] [instance: d013f581-2c2a-4935-98d5-53b0904118ac] Received unexpected event network-vif-plugged-65a4e6c3-627e-47fb-b1cf-c5e3f6cf3dce for instance with vm_state deleted and task_state None.
Nov 15 14:27:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:38 user nova-compute[74892]: INFO nova.compute.manager [None req-1d643e35-50c3-4314-8183-c4a7f42f2877 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Unrescuing
Nov 15 14:27:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1d643e35-50c3-4314-8183-c4a7f42f2877 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:27:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1d643e35-50c3-4314-8183-c4a7f42f2877 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquired lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:27:38 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1d643e35-50c3-4314-8183-c4a7f42f2877 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:27:38 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1d643e35-50c3-4314-8183-c4a7f42f2877 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:27:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1d643e35-50c3-4314-8183-c4a7f42f2877 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Releasing lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:27:38 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1d643e35-50c3-4314-8183-c4a7f42f2877 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'flavor' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-c418222a-a602-4dd8-a773-6aca638a9ff1 req-06e7ec4e-543d-4127-a255-0f9390c5f837 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c418222a-a602-4dd8-a773-6aca638a9ff1 req-06e7ec4e-543d-4127-a255-0f9390c5f837 service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c418222a-a602-4dd8-a773-6aca638a9ff1 req-06e7ec4e-543d-4127-a255-0f9390c5f837 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c418222a-a602-4dd8-a773-6aca638a9ff1 req-06e7ec4e-543d-4127-a255-0f9390c5f837 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-c418222a-a602-4dd8-a773-6aca638a9ff1 req-06e7ec4e-543d-4127-a255-0f9390c5f837 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:39 user nova-compute[74892]: WARNING nova.compute.manager [req-c418222a-a602-4dd8-a773-6aca638a9ff1 req-06e7ec4e-543d-4127-a255-0f9390c5f837 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:27:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-4eda7cf4-71e4-4331-8675-047b0228f23c req-e5ca00c1-b31c-4f62-988f-710d2395df72 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-changed-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-4eda7cf4-71e4-4331-8675-047b0228f23c req-e5ca00c1-b31c-4f62-988f-710d2395df72 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Refreshing instance network info cache due to event network-changed-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4eda7cf4-71e4-4331-8675-047b0228f23c req-e5ca00c1-b31c-4f62-988f-710d2395df72 service nova] Acquiring lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4eda7cf4-71e4-4331-8675-047b0228f23c req-e5ca00c1-b31c-4f62-988f-710d2395df72 service nova] Acquired lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:27:39 user nova-compute[74892]: DEBUG nova.network.neutron [req-4eda7cf4-71e4-4331-8675-047b0228f23c req-e5ca00c1-b31c-4f62-988f-710d2395df72 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Refreshing network info cache for port ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:27:39 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance destroyed successfully.
Nov 15 14:27:40 user nova-compute[74892]: DEBUG nova.network.neutron [req-4eda7cf4-71e4-4331-8675-047b0228f23c req-e5ca00c1-b31c-4f62-988f-710d2395df72 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updated VIF entry in instance network info cache for port ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:27:40 user nova-compute[74892]: DEBUG nova.network.neutron [req-4eda7cf4-71e4-4331-8675-047b0228f23c req-e5ca00c1-b31c-4f62-988f-710d2395df72 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:27:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4eda7cf4-71e4-4331-8675-047b0228f23c req-e5ca00c1-b31c-4f62-988f-710d2395df72 service nova] Releasing lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:27:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:40 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:40 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:41 user nova-compute[74892]: WARNING nova.compute.manager [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:27:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:41 user nova-compute[74892]: WARNING nova.compute.manager [req-04f83550-4a85-4a46-9284-a5b42bad59a4 req-bc4ddb5e-0334-45d4-a215-f4f9be7af96f service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:27:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-3f2a0cac-6862-406c-b018-6b0647ac7fa4 req-f9520b0a-adb0-4c64-9fa3-7c3cf9ecc75b service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-changed-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-3f2a0cac-6862-406c-b018-6b0647ac7fa4 req-f9520b0a-adb0-4c64-9fa3-7c3cf9ecc75b service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Refreshing instance network info cache due to event network-changed-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3f2a0cac-6862-406c-b018-6b0647ac7fa4 req-f9520b0a-adb0-4c64-9fa3-7c3cf9ecc75b service nova] Acquiring lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3f2a0cac-6862-406c-b018-6b0647ac7fa4 req-f9520b0a-adb0-4c64-9fa3-7c3cf9ecc75b service nova] Acquired lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG nova.network.neutron [req-3f2a0cac-6862-406c-b018-6b0647ac7fa4 req-f9520b0a-adb0-4c64-9fa3-7c3cf9ecc75b service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Refreshing network info cache for port ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:41 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-3f2a0cac-6862-406c-b018-6b0647ac7fa4 req-f9520b0a-adb0-4c64-9fa3-7c3cf9ecc75b service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updated VIF entry in instance network info cache for port ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-3f2a0cac-6862-406c-b018-6b0647ac7fa4 req-f9520b0a-adb0-4c64-9fa3-7c3cf9ecc75b service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-3f2a0cac-6862-406c-b018-6b0647ac7fa4 req-f9520b0a-adb0-4c64-9fa3-7c3cf9ecc75b service nova] Releasing lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:27:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-b6f7e56a-530f-4df7-be46-27af961e3bad req-f56e8166-1c5a-43a4-a062-2e4571db582a service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b6f7e56a-530f-4df7-be46-27af961e3bad req-f56e8166-1c5a-43a4-a062-2e4571db582a service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b6f7e56a-530f-4df7-be46-27af961e3bad req-f56e8166-1c5a-43a4-a062-2e4571db582a service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b6f7e56a-530f-4df7-be46-27af961e3bad req-f56e8166-1c5a-43a4-a062-2e4571db582a service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-b6f7e56a-530f-4df7-be46-27af961e3bad req-f56e8166-1c5a-43a4-a062-2e4571db582a service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:27:43 user nova-compute[74892]: WARNING nova.compute.manager [req-b6f7e56a-530f-4df7-be46-27af961e3bad req-f56e8166-1c5a-43a4-a062-2e4571db582a service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:27:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1d643e35-50c3-4314-8183-c4a7f42f2877 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:45 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:27:45 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7592MB free_disk=24.888153076171875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9e258725-b58a-46c8-a2f0-099e246564a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e9693214-e0c7-45c0-9542-3171b45712b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 532ff00e-4e44-4749-bc09-b5938b073005 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:27:45 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:27:46 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:27:46 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:27:46 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:27:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:27:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:27:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:27:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:27:48 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [{"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-9e258725-b58a-46c8-a2f0-099e246564a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:27:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:50 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:27:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:27:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:51 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:53 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:27:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:27:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:03 user nova-compute[74892]: INFO nova.compute.manager [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Unshelving
Nov 15 14:28:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'pci_requests' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'numa_topology' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:28:03 user nova-compute[74892]: INFO nova.compute.claims [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Claim successful on node user
Nov 15 14:28:03 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:28:03 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:04 user nova-compute[74892]: INFO nova.network.neutron [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating port 995f76ef-0e34-4c72-8c67-ff575231e6cf with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquired lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-07991348-cca9-43e7-b84d-a454f36ebe22 req-3d5ae36d-7a4d-4714-824b-d631a5e5c676 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-changed-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-07991348-cca9-43e7-b84d-a454f36ebe22 req-3d5ae36d-7a4d-4714-824b-d631a5e5c676 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Refreshing instance network info cache due to event network-changed-995f76ef-0e34-4c72-8c67-ff575231e6cf. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:28:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-07991348-cca9-43e7-b84d-a454f36ebe22 req-3d5ae36d-7a4d-4714-824b-d631a5e5c676 service nova] Acquiring lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating instance_info_cache with network_info: [{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Releasing lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:28:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Creating image(s)
Nov 15 14:28:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-07991348-cca9-43e7-b84d-a454f36ebe22 req-3d5ae36d-7a4d-4714-824b-d631a5e5c676 service nova] Acquired lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG nova.network.neutron [req-07991348-cca9-43e7-b84d-a454f36ebe22 req-3d5ae36d-7a4d-4714-824b-d631a5e5c676 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Refreshing network info cache for port 995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG nova.objects.base [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<5267e3dc-3c08-4046-836c-6ac540f0476d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "54147bef662088e8fea911ce7b37b896dc530011" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "54147bef662088e8fea911ce7b37b896dc530011" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG nova.virt.images [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] d431b08a-c0cf-409c-81a6-cc98988fa4af was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011.part /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG nova.network.neutron [req-07991348-cca9-43e7-b84d-a454f36ebe22 req-3d5ae36d-7a4d-4714-824b-d631a5e5c676 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updated VIF entry in instance network info cache for port 995f76ef-0e34-4c72-8c67-ff575231e6cf. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG nova.network.neutron [req-07991348-cca9-43e7-b84d-a454f36ebe22 req-3d5ae36d-7a4d-4714-824b-d631a5e5c676 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating instance_info_cache with network_info: [{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-07991348-cca9-43e7-b84d-a454f36ebe22 req-3d5ae36d-7a4d-4714-824b-d631a5e5c676 service nova] Releasing lock "refresh_cache-5267e3dc-3c08-4046-836c-6ac540f0476d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011.part /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011.converted" returned: 0 in 0.634s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "54147bef662088e8fea911ce7b37b896dc530011" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.212s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011 --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011 --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "54147bef662088e8fea911ce7b37b896dc530011" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "54147bef662088e8fea911ce7b37b896dc530011" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011 --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011 --force-share --output=json" returned: 0 in 0.164s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011,backing_fmt=raw /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011,backing_fmt=raw /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk 1073741824" returned: 0 in 0.053s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "54147bef662088e8fea911ce7b37b896dc530011" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011 --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011 --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:08 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'migration_context' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:08 user nova-compute[74892]: DEBUG nova.objects.base [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<5267e3dc-3c08-4046-836c-6ac540f0476d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Rebasing disk image.
Nov 15 14:28:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.186s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e -F raw /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e -F raw /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk" returned: 0 in 2.754s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Ensure instance console log exists: /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Start _get_guest_xml network_info=[{"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a144cfe3d2098aa5a075365446e83af2',container_format='bare',created_at=2023-11-15T14:26:11Z,direct_url=<?>,disk_format='qcow2',id=d431b08a-c0cf-409c-81a6-cc98988fa4af,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1209906851-shelved',owner='05fc70face4045788f0a46bd4cc29867',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T14:26:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:28:11 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:11 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a144cfe3d2098aa5a075365446e83af2',container_format='bare',created_at=2023-11-15T14:26:11Z,direct_url=<?>,disk_format='qcow2',id=d431b08a-c0cf-409c-81a6-cc98988fa4af,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1209906851-shelved',owner='05fc70face4045788f0a46bd4cc29867',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T14:26:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.objects.base [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<5267e3dc-3c08-4046-836c-6ac540f0476d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1209906851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1209906851',id=25,image_ref='d431b08a-c0cf-409c-81a6-cc98988fa4af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1742187766',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ey0qyk5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member',shelved_at='2023-11-15T14:26:15.956436',shelved_host='user',shelved_image_id='d431b08a-c0cf-409c-81a6-cc98988fa4af'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=5267e3dc-3c08-4046-836c-6ac540f0476d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'pci_devices' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.objects.base [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Object Instance<5267e3dc-3c08-4046-836c-6ac540f0476d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:28:11 user nova-compute[74892]:   <uuid>5267e3dc-3c08-4046-836c-6ac540f0476d</uuid>
Nov 15 14:28:11 user nova-compute[74892]:   <name>instance-00000019</name>
Nov 15 14:28:11 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:28:11 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:28:11 user nova-compute[74892]:   <metadata>
Nov 15 14:28:11 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:28:11 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:28:11 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1209906851</nova:name>
Nov 15 14:28:11 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:28:11</nova:creationTime>
Nov 15 14:28:11 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:28:11 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:28:11 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:28:11 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:28:11 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:28:11 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:28:11 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:28:11 user nova-compute[74892]:       <nova:owner>
Nov 15 14:28:11 user nova-compute[74892]:         <nova:user uuid="0c3e99992fb747808166fdd03a2420ff">tempest-AttachVolumeShelveTestJSON-769417742-project-member</nova:user>
Nov 15 14:28:11 user nova-compute[74892]:         <nova:project uuid="05fc70face4045788f0a46bd4cc29867">tempest-AttachVolumeShelveTestJSON-769417742</nova:project>
Nov 15 14:28:11 user nova-compute[74892]:       </nova:owner>
Nov 15 14:28:11 user nova-compute[74892]:       <nova:root type="image" uuid="d431b08a-c0cf-409c-81a6-cc98988fa4af"/>
Nov 15 14:28:11 user nova-compute[74892]:       <nova:ports>
Nov 15 14:28:11 user nova-compute[74892]:         <nova:port uuid="995f76ef-0e34-4c72-8c67-ff575231e6cf">
Nov 15 14:28:11 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:28:11 user nova-compute[74892]:         </nova:port>
Nov 15 14:28:11 user nova-compute[74892]:       </nova:ports>
Nov 15 14:28:11 user nova-compute[74892]:     </nova:instance>
Nov 15 14:28:11 user nova-compute[74892]:   </metadata>
Nov 15 14:28:11 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:28:11 user nova-compute[74892]:     <system>
Nov 15 14:28:11 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:28:11 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:28:11 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:28:11 user nova-compute[74892]:       <entry name="serial">5267e3dc-3c08-4046-836c-6ac540f0476d</entry>
Nov 15 14:28:11 user nova-compute[74892]:       <entry name="uuid">5267e3dc-3c08-4046-836c-6ac540f0476d</entry>
Nov 15 14:28:11 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:28:11 user nova-compute[74892]:     </system>
Nov 15 14:28:11 user nova-compute[74892]:   </sysinfo>
Nov 15 14:28:11 user nova-compute[74892]:   <os>
Nov 15 14:28:11 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:28:11 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:28:11 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:28:11 user nova-compute[74892]:   </os>
Nov 15 14:28:11 user nova-compute[74892]:   <features>
Nov 15 14:28:11 user nova-compute[74892]:     <acpi/>
Nov 15 14:28:11 user nova-compute[74892]:     <apic/>
Nov 15 14:28:11 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:28:11 user nova-compute[74892]:   </features>
Nov 15 14:28:11 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:28:11 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:28:11 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:28:11 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:28:11 user nova-compute[74892]:   </clock>
Nov 15 14:28:11 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:28:11 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:28:11 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:28:11 user nova-compute[74892]:   </cpu>
Nov 15 14:28:11 user nova-compute[74892]:   <devices>
Nov 15 14:28:11 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:28:11 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:28:11 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk"/>
Nov 15 14:28:11 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:28:11 user nova-compute[74892]:     </disk>
Nov 15 14:28:11 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:28:11 user nova-compute[74892]:       <mac address="fa:16:3e:4a:3a:e4"/>
Nov 15 14:28:11 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:11 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:28:11 user nova-compute[74892]:       <target dev="tap995f76ef-0e"/>
Nov 15 14:28:11 user nova-compute[74892]:     </interface>
Nov 15 14:28:11 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:28:11 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/console.log" append="off"/>
Nov 15 14:28:11 user nova-compute[74892]:     </serial>
Nov 15 14:28:11 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:28:11 user nova-compute[74892]:     <video>
Nov 15 14:28:11 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:11 user nova-compute[74892]:     </video>
Nov 15 14:28:11 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:28:11 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:28:11 user nova-compute[74892]:     </rng>
Nov 15 14:28:11 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:28:11 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:28:11 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:28:11 user nova-compute[74892]:     </memballoon>
Nov 15 14:28:11 user nova-compute[74892]:   </devices>
Nov 15 14:28:11 user nova-compute[74892]: </domain>
Nov 15 14:28:11 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1209906851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1209906851',id=25,image_ref='d431b08a-c0cf-409c-81a6-cc98988fa4af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1742187766',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:24:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ey0qyk5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member',shelved_at='2023-11-15T14:26:15.956436',shelved_host='user',shelved_image_id='d431b08a-c0cf-409c-81a6-cc98988fa4af'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=5267e3dc-3c08-4046-836c-6ac540f0476d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG os_vif [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f70e2397-d568-56a0-bd26-43eaf658a5cf', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap995f76ef-0e, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap995f76ef-0e, col_values=(('qos', UUID('cab76d0c-4ef7-44ef-b877-84705590a3f7')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap995f76ef-0e, col_values=(('external_ids', {'iface-id': '995f76ef-0e34-4c72-8c67-ff575231e6cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:3a:e4', 'vm-uuid': '5267e3dc-3c08-4046-836c-6ac540f0476d'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:11 user nova-compute[74892]: INFO os_vif [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e')
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] No VIF found with MAC fa:16:3e:4a:3a:e4, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:11 user nova-compute[74892]: INFO nova.compute.manager [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Detaching volume 5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:28:11 user nova-compute[74892]: INFO nova.virt.block_device [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Attempting to driver detach volume 5330b2fc-675d-435e-a878-71ec42854e22 from mountpoint /dev/vdb
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Attempting to detach device vdb from instance 9e258725-b58a-46c8-a2f0-099e246564a6 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:28:11 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:11 user nova-compute[74892]:   <source dev="/dev/sde"/>
Nov 15 14:28:11 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:28:11 user nova-compute[74892]:   <serial>5330b2fc-675d-435e-a878-71ec42854e22</serial>
Nov 15 14:28:11 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:28:11 user nova-compute[74892]: </disk>
Nov 15 14:28:11 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:28:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Successfully detached device vdb from instance 9e258725-b58a-46c8-a2f0-099e246564a6 from the persistent domain config.
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9e258725-b58a-46c8-a2f0-099e246564a6 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:28:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:28:11 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:11 user nova-compute[74892]:   <source dev="/dev/sde"/>
Nov 15 14:28:11 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:28:11 user nova-compute[74892]:   <serial>5330b2fc-675d-435e-a878-71ec42854e22</serial>
Nov 15 14:28:11 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:28:11 user nova-compute[74892]: </disk>
Nov 15 14:28:11 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:28:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:28:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-0249aa18-e319-47ef-8dfe-fdecfda86c0d req-8e63a5bf-fb32-4008-9f8c-e3bb319d442c service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0249aa18-e319-47ef-8dfe-fdecfda86c0d req-8e63a5bf-fb32-4008-9f8c-e3bb319d442c service nova] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0249aa18-e319-47ef-8dfe-fdecfda86c0d req-8e63a5bf-fb32-4008-9f8c-e3bb319d442c service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0249aa18-e319-47ef-8dfe-fdecfda86c0d req-8e63a5bf-fb32-4008-9f8c-e3bb319d442c service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-0249aa18-e319-47ef-8dfe-fdecfda86c0d req-8e63a5bf-fb32-4008-9f8c-e3bb319d442c service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] No waiting events found dispatching network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:13 user nova-compute[74892]: WARNING nova.compute.manager [req-0249aa18-e319-47ef-8dfe-fdecfda86c0d req-8e63a5bf-fb32-4008-9f8c-e3bb319d442c service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received unexpected event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 14:28:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:28:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:14 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:28:14 user nova-compute[74892]: INFO nova.compute.claims [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Claim successful on node user
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:28:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance spawned successfully.
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:28:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-ddca78f1-28e9-40c9-8be2-bbc8364bba79 req-7587ef8d-08a0-4f72-a25f-de79f6c46794 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ddca78f1-28e9-40c9-8be2-bbc8364bba79 req-7587ef8d-08a0-4f72-a25f-de79f6c46794 service nova] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ddca78f1-28e9-40c9-8be2-bbc8364bba79 req-7587ef8d-08a0-4f72-a25f-de79f6c46794 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ddca78f1-28e9-40c9-8be2-bbc8364bba79 req-7587ef8d-08a0-4f72-a25f-de79f6c46794 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-ddca78f1-28e9-40c9-8be2-bbc8364bba79 req-7587ef8d-08a0-4f72-a25f-de79f6c46794 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] No waiting events found dispatching network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:15 user nova-compute[74892]: WARNING nova.compute.manager [req-ddca78f1-28e9-40c9-8be2-bbc8364bba79 req-7587ef8d-08a0-4f72-a25f-de79f6c46794 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received unexpected event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 14:28:15 user nova-compute[74892]: INFO nova.virt.block_device [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Booting with volume-backed-image 557dbecf-dbbd-46c7-999f-66066c1bea36 at /dev/vda
Nov 15 14:28:15 user nova-compute[74892]: DEBUG nova.policy [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eccd14bd0c974f4a83aba63fd70df073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fcc169292ce42fb9f54aab1db3869bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:28:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ffc184f0-b62c-4dd4-94fe-0535b0b322d5 tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.066s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Successfully created port: b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:28:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Successfully updated port: b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquired lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-abc54307-ff5d-438d-876d-f43dcada9f8e req-274ac3cc-277d-49f9-a3a3-fe97acbf64ce service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-changed-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-abc54307-ff5d-438d-876d-f43dcada9f8e req-274ac3cc-277d-49f9-a3a3-fe97acbf64ce service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Refreshing instance network info cache due to event network-changed-b3d70342-7983-4724-8efd-b482ab015807. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abc54307-ff5d-438d-876d-f43dcada9f8e req-274ac3cc-277d-49f9-a3a3-fe97acbf64ce service nova] Acquiring lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Updating instance_info_cache with network_info: [{"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Releasing lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance network_info: |[{"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abc54307-ff5d-438d-876d-f43dcada9f8e req-274ac3cc-277d-49f9-a3a3-fe97acbf64ce service nova] Acquired lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:17 user nova-compute[74892]: DEBUG nova.network.neutron [req-abc54307-ff5d-438d-876d-f43dcada9f8e req-274ac3cc-277d-49f9-a3a3-fe97acbf64ce service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Refreshing network info cache for port b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:28:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-abc54307-ff5d-438d-876d-f43dcada9f8e req-274ac3cc-277d-49f9-a3a3-fe97acbf64ce service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Updated VIF entry in instance network info cache for port b3d70342-7983-4724-8efd-b482ab015807. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:28:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-abc54307-ff5d-438d-876d-f43dcada9f8e req-274ac3cc-277d-49f9-a3a3-fe97acbf64ce service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Updating instance_info_cache with network_info: [{"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abc54307-ff5d-438d-876d-f43dcada9f8e req-274ac3cc-277d-49f9-a3a3-fe97acbf64ce service nova] Releasing lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:20 user nova-compute[74892]: DEBUG nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:28:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:28:20 user nova-compute[74892]: INFO nova.compute.claims [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Claim successful on node user
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.network.neutron [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:28:21 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG os_brick.utils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.policy [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '494e2c6ede5c47ed8af6d1399ad8a06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d5b81e2d940589392aa33ffb900e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac9a971-fd9f-4ea9-b842-a06a5972c5f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[99786a83-93af-411a-996c-81b5a39cb7e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fccc41d-f6a8-4bc8-91e7-6c96554614ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e4e41e-d0e4-4ff9-9955-3639dbefc90d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:28:21 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Creating image(s)
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "/opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "/opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "/opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:21 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd1cb3-e40a-409a-8afb-e63ec1bc061b]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG os_brick.utils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Updating existing volume attachment record: d96b756c-5b42-414a-863b-7fcd0fccd2fb {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.229s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk 1073741824" returned: 0 in 0.084s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.224s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.network.neutron [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Successfully created port: b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:28:22 user nova-compute[74892]: INFO nova.compute.claims [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Claim successful on node user
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Cannot resize image /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Ensure instance console log exists: /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-8e7c6cdf-4baa-4962-9344-491bbbe98988 req-6ef920f1-8fcf-4a6b-bf34-907917f8fc39 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-changed-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-8e7c6cdf-4baa-4962-9344-491bbbe98988 req-6ef920f1-8fcf-4a6b-bf34-907917f8fc39 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Refreshing instance network info cache due to event network-changed-39ff716a-e25e-481c-b0ef-86fdc490898f. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8e7c6cdf-4baa-4962-9344-491bbbe98988 req-6ef920f1-8fcf-4a6b-bf34-907917f8fc39 service nova] Acquiring lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8e7c6cdf-4baa-4962-9344-491bbbe98988 req-6ef920f1-8fcf-4a6b-bf34-907917f8fc39 service nova] Acquired lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:22 user nova-compute[74892]: DEBUG nova.network.neutron [req-8e7c6cdf-4baa-4962-9344-491bbbe98988 req-6ef920f1-8fcf-4a6b-bf34-907917f8fc39 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Refreshing network info cache for port 39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Successfully updated port: b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquired lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.670s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-33f8a570-f9d3-49eb-a764-63d498030bd4 req-ad95de6a-b66e-4935-b685-6f9cab1ebc12 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received event network-changed-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-33f8a570-f9d3-49eb-a764-63d498030bd4 req-ad95de6a-b66e-4935-b685-6f9cab1ebc12 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Refreshing instance network info cache due to event network-changed-b7300fe3-c946-4407-859b-953d171638f3. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33f8a570-f9d3-49eb-a764-63d498030bd4 req-ad95de6a-b66e-4935-b685-6f9cab1ebc12 service nova] Acquiring lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:28:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:28:23 user nova-compute[74892]: INFO nova.virt.block_device [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Booting with volume f7463944-aa87-4fae-9e85-4ec46ba5038f at /dev/vda
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.policy [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abe166e9b6134abf85db0e21ec1e100d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbe544848b48449381967e24f274b7bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG os_brick.utils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[81352b40-78a9-48fb-8c97-31524df62692]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed773dee-f465-435b-8beb-59810ec0a195]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd19446-167b-420d-ae13-2575af1d785a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b459d550-bd2c-4d95-89c8-976ac2f11c2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.neutron [req-8e7c6cdf-4baa-4962-9344-491bbbe98988 req-6ef920f1-8fcf-4a6b-bf34-907917f8fc39 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Updated VIF entry in instance network info cache for port 39ff716a-e25e-481c-b0ef-86fdc490898f. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.neutron [req-8e7c6cdf-4baa-4962-9344-491bbbe98988 req-6ef920f1-8fcf-4a6b-bf34-907917f8fc39 service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Updating instance_info_cache with network_info: [{"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Updating instance_info_cache with network_info: [{"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:23 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa9e66-6391-4018-8728-734c253bbbef]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG os_brick.utils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating existing volume attachment record: 1bfc15ae-7667-48d8-88d4-bf3a4dbbde53 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Releasing lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Instance network_info: |[{"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8e7c6cdf-4baa-4962-9344-491bbbe98988 req-6ef920f1-8fcf-4a6b-bf34-907917f8fc39 service nova] Releasing lock "refresh_cache-e9693214-e0c7-45c0-9542-3171b45712b4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33f8a570-f9d3-49eb-a764-63d498030bd4 req-ad95de6a-b66e-4935-b685-6f9cab1ebc12 service nova] Acquired lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.neutron [req-33f8a570-f9d3-49eb-a764-63d498030bd4 req-ad95de6a-b66e-4935-b685-6f9cab1ebc12 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Refreshing network info cache for port b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Start _get_guest_xml network_info=[{"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:28:23 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:23 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-529045353',display_name='tempest-AttachVolumeNegativeTest-server-529045353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-529045353',id=34,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtHhROUYhr4rgN0fZ7k4eL+MKbi8+NzrlxOXXDvsG4G8drEpkyzl3MC/UKsLX+lossQrhj4VZtKYRTEywCjf8A9iY80WgI/EU9c1q/S71HD00sLzBTDtwmaGc0kNi6LHA==',key_name='tempest-keypair-2139922210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-8fgsplaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=7494d800-9096-4cfd-97f7-659fe4f1dcf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:32:68,bridge_name='br-int',has_traffic_filtering=True,id=b7300fe3-c946-4407-859b-953d171638f3,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7300fe3-c9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.objects.instance [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'pci_devices' on Instance uuid 7494d800-9096-4cfd-97f7-659fe4f1dcf2 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:28:23 user nova-compute[74892]:   <uuid>7494d800-9096-4cfd-97f7-659fe4f1dcf2</uuid>
Nov 15 14:28:23 user nova-compute[74892]:   <name>instance-00000022</name>
Nov 15 14:28:23 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:28:23 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:28:23 user nova-compute[74892]:   <metadata>
Nov 15 14:28:23 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:28:23 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:28:23 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeNegativeTest-server-529045353</nova:name>
Nov 15 14:28:23 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:28:23</nova:creationTime>
Nov 15 14:28:23 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:28:23 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:28:23 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:28:23 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:28:23 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:28:23 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:28:23 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:28:23 user nova-compute[74892]:       <nova:owner>
Nov 15 14:28:23 user nova-compute[74892]:         <nova:user uuid="494e2c6ede5c47ed8af6d1399ad8a06a">tempest-AttachVolumeNegativeTest-2132166828-project-member</nova:user>
Nov 15 14:28:23 user nova-compute[74892]:         <nova:project uuid="6c2d5b81e2d940589392aa33ffb900e2">tempest-AttachVolumeNegativeTest-2132166828</nova:project>
Nov 15 14:28:23 user nova-compute[74892]:       </nova:owner>
Nov 15 14:28:23 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:28:23 user nova-compute[74892]:       <nova:ports>
Nov 15 14:28:23 user nova-compute[74892]:         <nova:port uuid="b7300fe3-c946-4407-859b-953d171638f3">
Nov 15 14:28:23 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:28:23 user nova-compute[74892]:         </nova:port>
Nov 15 14:28:23 user nova-compute[74892]:       </nova:ports>
Nov 15 14:28:23 user nova-compute[74892]:     </nova:instance>
Nov 15 14:28:23 user nova-compute[74892]:   </metadata>
Nov 15 14:28:23 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:28:23 user nova-compute[74892]:     <system>
Nov 15 14:28:23 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:28:23 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:28:23 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:28:23 user nova-compute[74892]:       <entry name="serial">7494d800-9096-4cfd-97f7-659fe4f1dcf2</entry>
Nov 15 14:28:23 user nova-compute[74892]:       <entry name="uuid">7494d800-9096-4cfd-97f7-659fe4f1dcf2</entry>
Nov 15 14:28:23 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:28:23 user nova-compute[74892]:     </system>
Nov 15 14:28:23 user nova-compute[74892]:   </sysinfo>
Nov 15 14:28:23 user nova-compute[74892]:   <os>
Nov 15 14:28:23 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:28:23 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:28:23 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:28:23 user nova-compute[74892]:   </os>
Nov 15 14:28:23 user nova-compute[74892]:   <features>
Nov 15 14:28:23 user nova-compute[74892]:     <acpi/>
Nov 15 14:28:23 user nova-compute[74892]:     <apic/>
Nov 15 14:28:23 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:28:23 user nova-compute[74892]:   </features>
Nov 15 14:28:23 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:28:23 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:28:23 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:28:23 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:28:23 user nova-compute[74892]:   </clock>
Nov 15 14:28:23 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:28:23 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:28:23 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:28:23 user nova-compute[74892]:   </cpu>
Nov 15 14:28:23 user nova-compute[74892]:   <devices>
Nov 15 14:28:23 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:28:23 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:28:23 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk"/>
Nov 15 14:28:23 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:28:23 user nova-compute[74892]:     </disk>
Nov 15 14:28:23 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:28:23 user nova-compute[74892]:       <mac address="fa:16:3e:01:32:68"/>
Nov 15 14:28:23 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:23 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:28:23 user nova-compute[74892]:       <target dev="tapb7300fe3-c9"/>
Nov 15 14:28:23 user nova-compute[74892]:     </interface>
Nov 15 14:28:23 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:28:23 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/console.log" append="off"/>
Nov 15 14:28:23 user nova-compute[74892]:     </serial>
Nov 15 14:28:23 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:28:23 user nova-compute[74892]:     <video>
Nov 15 14:28:23 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:23 user nova-compute[74892]:     </video>
Nov 15 14:28:23 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:28:23 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:28:23 user nova-compute[74892]:     </rng>
Nov 15 14:28:23 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:28:23 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:28:23 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:28:23 user nova-compute[74892]:     </memballoon>
Nov 15 14:28:23 user nova-compute[74892]:   </devices>
Nov 15 14:28:23 user nova-compute[74892]: </domain>
Nov 15 14:28:23 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-529045353',display_name='tempest-AttachVolumeNegativeTest-server-529045353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-529045353',id=34,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtHhROUYhr4rgN0fZ7k4eL+MKbi8+NzrlxOXXDvsG4G8drEpkyzl3MC/UKsLX+lossQrhj4VZtKYRTEywCjf8A9iY80WgI/EU9c1q/S71HD00sLzBTDtwmaGc0kNi6LHA==',key_name='tempest-keypair-2139922210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-8fgsplaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=7494d800-9096-4cfd-97f7-659fe4f1dcf2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:32:68,bridge_name='br-int',has_traffic_filtering=True,id=b7300fe3-c946-4407-859b-953d171638f3,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7300fe3-c9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG os_vif [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:32:68,bridge_name='br-int',has_traffic_filtering=True,id=b7300fe3-c946-4407-859b-953d171638f3,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7300fe3-c9') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc8e1849-72b6-559c-b476-be000780c87a', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.objects.instance [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lazy-loading 'flavor' on Instance uuid e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7300fe3-c9, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7300fe3-c9, col_values=(('qos', UUID('ee18ab6f-191e-4496-9609-99cfe9866ac5')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7300fe3-c9, col_values=(('external_ids', {'iface-id': 'b7300fe3-c946-4407-859b-953d171638f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:32:68', 'vm-uuid': '7494d800-9096-4cfd-97f7-659fe4f1dcf2'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:23 user nova-compute[74892]: INFO os_vif [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:32:68,bridge_name='br-int',has_traffic_filtering=True,id=b7300fe3-c946-4407-859b-953d171638f3,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7300fe3-c9')
Nov 15 14:28:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No VIF found with MAC fa:16:3e:01:32:68, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:24 user nova-compute[74892]: INFO nova.compute.manager [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Attaching volume 7509c7c6-8a33-4549-b8c6-108f5d04b02e to /dev/vdb
Nov 15 14:28:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-33f8a570-f9d3-49eb-a764-63d498030bd4 req-ad95de6a-b66e-4935-b685-6f9cab1ebc12 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Updated VIF entry in instance network info cache for port b7300fe3-c946-4407-859b-953d171638f3. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-33f8a570-f9d3-49eb-a764-63d498030bd4 req-ad95de6a-b66e-4935-b685-6f9cab1ebc12 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Updating instance_info_cache with network_info: [{"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-33f8a570-f9d3-49eb-a764-63d498030bd4 req-ad95de6a-b66e-4935-b685-6f9cab1ebc12 service nova] Releasing lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG os_brick.utils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadc86d5-80f1-41db-85cb-c597e7a93de7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[620b24db-64a9-4180-b622-e1dd6c87f0cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18b5b33-fc5a-4ef2-bebe-9a3a6a4607a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b71c959-e630-4c2f-b112-d591349cf634]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:24 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:28:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede03ace-fc42-40f2-ba10-a616673602ea]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG os_brick.utils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:24 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Updating existing volume attachment record: 9607c1cc-4cfa-4fbe-9ba2-d08c9dc56d3f {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG nova.network.neutron [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Successfully created port: 90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-aa6f442c-0dae-46ee-886d-806ae82f8426 req-826d1cab-a78b-455e-8186-48c64c580e42 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received event network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-aa6f442c-0dae-46ee-886d-806ae82f8426 req-826d1cab-a78b-455e-8186-48c64c580e42 service nova] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-aa6f442c-0dae-46ee-886d-806ae82f8426 req-826d1cab-a78b-455e-8186-48c64c580e42 service nova] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-aa6f442c-0dae-46ee-886d-806ae82f8426 req-826d1cab-a78b-455e-8186-48c64c580e42 service nova] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-aa6f442c-0dae-46ee-886d-806ae82f8426 req-826d1cab-a78b-455e-8186-48c64c580e42 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] No waiting events found dispatching network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:25 user nova-compute[74892]: WARNING nova.compute.manager [req-aa6f442c-0dae-46ee-886d-806ae82f8426 req-826d1cab-a78b-455e-8186-48c64c580e42 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received unexpected event network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 for instance with vm_state building and task_state spawning.
Nov 15 14:28:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG nova.network.neutron [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Successfully updated port: 90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquired lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG nova.network.neutron [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG nova.network.neutron [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:28:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-a4dbbb72-d87a-4b33-9489-be3e9a899a9c req-c8d2671b-9d8d-4712-81c3-58a1a360573c service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-changed-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-a4dbbb72-d87a-4b33-9489-be3e9a899a9c req-c8d2671b-9d8d-4712-81c3-58a1a360573c service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Refreshing instance network info cache due to event network-changed-90e29962-319e-43d8-b270-26d1859d0d36. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a4dbbb72-d87a-4b33-9489-be3e9a899a9c req-c8d2671b-9d8d-4712-81c3-58a1a360573c service nova] Acquiring lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.network.neutron [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating instance_info_cache with network_info: [{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Releasing lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance network_info: |[{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a4dbbb72-d87a-4b33-9489-be3e9a899a9c req-c8d2671b-9d8d-4712-81c3-58a1a360573c service nova] Acquired lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.network.neutron [req-a4dbbb72-d87a-4b33-9489-be3e9a899a9c req-c8d2671b-9d8d-4712-81c3-58a1a360573c service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Refreshing network info cache for port 90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.network.neutron [req-a4dbbb72-d87a-4b33-9489-be3e9a899a9c req-c8d2671b-9d8d-4712-81c3-58a1a360573c service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updated VIF entry in instance network info cache for port 90e29962-319e-43d8-b270-26d1859d0d36. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.network.neutron [req-a4dbbb72-d87a-4b33-9489-be3e9a899a9c req-c8d2671b-9d8d-4712-81c3-58a1a360573c service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating instance_info_cache with network_info: [{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a4dbbb72-d87a-4b33-9489-be3e9a899a9c req-c8d2671b-9d8d-4712-81c3-58a1a360573c service nova] Releasing lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:28:27 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Instance spawned successfully.
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-01a81b56-59fc-432d-8ca7-322183d5a761 req-1e25e19b-5cce-492f-bff6-8a2acda861bb service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received event network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-01a81b56-59fc-432d-8ca7-322183d5a761 req-1e25e19b-5cce-492f-bff6-8a2acda861bb service nova] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-01a81b56-59fc-432d-8ca7-322183d5a761 req-1e25e19b-5cce-492f-bff6-8a2acda861bb service nova] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-01a81b56-59fc-432d-8ca7-322183d5a761 req-1e25e19b-5cce-492f-bff6-8a2acda861bb service nova] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-01a81b56-59fc-432d-8ca7-322183d5a761 req-1e25e19b-5cce-492f-bff6-8a2acda861bb service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] No waiting events found dispatching network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:27 user nova-compute[74892]: WARNING nova.compute.manager [req-01a81b56-59fc-432d-8ca7-322183d5a761 req-1e25e19b-5cce-492f-bff6-8a2acda861bb service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received unexpected event network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 for instance with vm_state building and task_state spawning.
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:28:27 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Creating image(s)
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Ensure instance console log exists: /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Start _get_guest_xml network_info=[{"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxXKCWjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '144bf11d-fc91-4bcb-9c63-3e11b3d8661b', 'attached_at': '', 'detached_at': '', 'volume_id': '8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'serial': '8ddb1715-360f-47d9-9c13-ceadfd15e6bc'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'd96b756c-5b42-414a-863b-7fcd0fccd2fb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:28:27 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:27 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxXKCWjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:27 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:28 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:28 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: INFO nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 15 14:28:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e89e84e-9caf-460d-bb27-de3272c53b63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:28:28 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd0954b-c07f-40b7-b5fd-7f599385765c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc] added
Nov 15 14:28:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1765f4c-3e9e-4280-81bb-25089618d1cf]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: INFO nova.compute.manager [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Took 7.55 seconds to build instance.
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e10718d-347c-4df6-8d5c-ca3518c25508]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxXKCWjR {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-079d5c31-da4a-4e0c-b3f5-cbdbf3410806 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.708s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxXKCWjR" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a3d6ab-0ca5-4f2f-a644-c30b1b5b7c3b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QxXKCWjR'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[640b9552-88df-4723-ae9a-6a7c52984c6f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.170s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[117182b3-e770-493b-82bd-38c08e44e8a3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:28 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:28:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:28 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:28:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[581f0de9-8ae9-4bcb-bd4b-b5272a38653c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc, portal: 172.16.0.220,3260]
Nov 15 14:28:28 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc, portal: 172.16.0.220,3260] successful.
Nov 15 14:28:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731dab1-f0f3-4799-bcb6-da7939375116]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8dcf2c-605e-443e-af15-4cecd107a980]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:28 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:28:28 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:28 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:28:28 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.634s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf90ac0-1c37-47fe-a2a4-0a689dea8269]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxXKCWjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:28:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.679s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] <== connect_volume: return (1683ms) {'type': 'block', 'scsi_wwn': '26537356636613931', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537356636613931', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1598376678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1598376678',id=33,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-pamncegq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:15Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=144bf11d-fc91-4bcb-9c63-3e11b3d8661b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:20:e4,bridge_name='br-int',has_traffic_filtering=True,id=b3d70342-7983-4724-8efd-b482ab015807,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d70342-79') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.objects.instance [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'pci_devices' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:28:29 user nova-compute[74892]:   <uuid>144bf11d-fc91-4bcb-9c63-3e11b3d8661b</uuid>
Nov 15 14:28:29 user nova-compute[74892]:   <name>instance-00000021</name>
Nov 15 14:28:29 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:28:29 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:28:29 user nova-compute[74892]:   <metadata>
Nov 15 14:28:29 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:28:29 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:28:29 user nova-compute[74892]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1598376678</nova:name>
Nov 15 14:28:29 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:28:27</nova:creationTime>
Nov 15 14:28:29 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:28:29 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:28:29 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:28:29 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:28:29 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:28:29 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:28:29 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:28:29 user nova-compute[74892]:       <nova:owner>
Nov 15 14:28:29 user nova-compute[74892]:         <nova:user uuid="eccd14bd0c974f4a83aba63fd70df073">tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member</nova:user>
Nov 15 14:28:29 user nova-compute[74892]:         <nova:project uuid="3fcc169292ce42fb9f54aab1db3869bd">tempest-ServerBootFromVolumeStableRescueTest-760148567</nova:project>
Nov 15 14:28:29 user nova-compute[74892]:       </nova:owner>
Nov 15 14:28:29 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:28:29 user nova-compute[74892]:       <nova:ports>
Nov 15 14:28:29 user nova-compute[74892]:         <nova:port uuid="b3d70342-7983-4724-8efd-b482ab015807">
Nov 15 14:28:29 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 14:28:29 user nova-compute[74892]:         </nova:port>
Nov 15 14:28:29 user nova-compute[74892]:       </nova:ports>
Nov 15 14:28:29 user nova-compute[74892]:     </nova:instance>
Nov 15 14:28:29 user nova-compute[74892]:   </metadata>
Nov 15 14:28:29 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:28:29 user nova-compute[74892]:     <system>
Nov 15 14:28:29 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:28:29 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:28:29 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:28:29 user nova-compute[74892]:       <entry name="serial">144bf11d-fc91-4bcb-9c63-3e11b3d8661b</entry>
Nov 15 14:28:29 user nova-compute[74892]:       <entry name="uuid">144bf11d-fc91-4bcb-9c63-3e11b3d8661b</entry>
Nov 15 14:28:29 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:28:29 user nova-compute[74892]:     </system>
Nov 15 14:28:29 user nova-compute[74892]:   </sysinfo>
Nov 15 14:28:29 user nova-compute[74892]:   <os>
Nov 15 14:28:29 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:28:29 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:28:29 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:28:29 user nova-compute[74892]:   </os>
Nov 15 14:28:29 user nova-compute[74892]:   <features>
Nov 15 14:28:29 user nova-compute[74892]:     <acpi/>
Nov 15 14:28:29 user nova-compute[74892]:     <apic/>
Nov 15 14:28:29 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:28:29 user nova-compute[74892]:   </features>
Nov 15 14:28:29 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:28:29 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:28:29 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:28:29 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:28:29 user nova-compute[74892]:   </clock>
Nov 15 14:28:29 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:28:29 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:28:29 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:28:29 user nova-compute[74892]:   </cpu>
Nov 15 14:28:29 user nova-compute[74892]:   <devices>
Nov 15 14:28:29 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:28:29 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:29 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:28:29 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:28:29 user nova-compute[74892]:       <serial>8ddb1715-360f-47d9-9c13-ceadfd15e6bc</serial>
Nov 15 14:28:29 user nova-compute[74892]:     </disk>
Nov 15 14:28:29 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:28:29 user nova-compute[74892]:       <mac address="fa:16:3e:0e:20:e4"/>
Nov 15 14:28:29 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:29 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:28:29 user nova-compute[74892]:       <target dev="tapb3d70342-79"/>
Nov 15 14:28:29 user nova-compute[74892]:     </interface>
Nov 15 14:28:29 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:28:29 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/console.log" append="off"/>
Nov 15 14:28:29 user nova-compute[74892]:     </serial>
Nov 15 14:28:29 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:28:29 user nova-compute[74892]:     <video>
Nov 15 14:28:29 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:29 user nova-compute[74892]:     </video>
Nov 15 14:28:29 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:28:29 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:28:29 user nova-compute[74892]:     </rng>
Nov 15 14:28:29 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:28:29 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:28:29 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:28:29 user nova-compute[74892]:     </memballoon>
Nov 15 14:28:29 user nova-compute[74892]:   </devices>
Nov 15 14:28:29 user nova-compute[74892]: </domain>
Nov 15 14:28:29 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1598376678',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1598376678',id=33,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-pamncegq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:15Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=144bf11d-fc91-4bcb-9c63-3e11b3d8661b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:20:e4,bridge_name='br-int',has_traffic_filtering=True,id=b3d70342-7983-4724-8efd-b482ab015807,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d70342-79') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG os_vif [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:20:e4,bridge_name='br-int',has_traffic_filtering=True,id=b3d70342-7983-4724-8efd-b482ab015807,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d70342-79') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b4a41fe8-181d-5000-bbe3-03364e708c7e', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3d70342-79, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3d70342-79, col_values=(('qos', UUID('0dc8305d-9a67-4d0b-994e-f29944dcb26a')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3d70342-79, col_values=(('external_ids', {'iface-id': 'b3d70342-7983-4724-8efd-b482ab015807', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:20:e4', 'vm-uuid': '144bf11d-fc91-4bcb-9c63-3e11b3d8661b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:29 user nova-compute[74892]: INFO os_vif [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:20:e4,bridge_name='br-int',has_traffic_filtering=True,id=b3d70342-7983-4724-8efd-b482ab015807,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d70342-79')
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No VIF found with MAC fa:16:3e:0e:20:e4, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:28:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-fee44197-54a5-4866-9c17-88c3fbe30451 req-e6e0681a-393d-49aa-9dd0-1532a1d09358 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fee44197-54a5-4866-9c17-88c3fbe30451 req-e6e0681a-393d-49aa-9dd0-1532a1d09358 service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fee44197-54a5-4866-9c17-88c3fbe30451 req-e6e0681a-393d-49aa-9dd0-1532a1d09358 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fee44197-54a5-4866-9c17-88c3fbe30451 req-e6e0681a-393d-49aa-9dd0-1532a1d09358 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-fee44197-54a5-4866-9c17-88c3fbe30451 req-e6e0681a-393d-49aa-9dd0-1532a1d09358 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:31 user nova-compute[74892]: WARNING nova.compute.manager [req-fee44197-54a5-4866-9c17-88c3fbe30451 req-e6e0681a-393d-49aa-9dd0-1532a1d09358 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state building and task_state spawning.
Nov 15 14:28:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:32 user nova-compute[74892]: INFO nova.compute.manager [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Rescuing
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquired lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:28:32 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9e258725-b58a-46c8-a2f0-099e246564a6 is timed out.
Nov 15 14:28:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Successfully detached device vdb from instance 9e258725-b58a-46c8-a2f0-099e246564a6 from the live domain config.
Nov 15 14:28:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyUVeilh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:32 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c794ba1-3347-435f-bc23-b2f81981d544]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:28:32 user nova-compute[74892]: No targets found.
Nov 15 14:28:32 user nova-compute[74892]: iSNS:
Nov 15 14:28:32 user nova-compute[74892]: No targets found.
Nov 15 14:28:32 user nova-compute[74892]: STATIC:
Nov 15 14:28:32 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:28:32 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:28:32 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:28:32 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22
Nov 15 14:28:32 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:28:32 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:28:32 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:28:32 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:28:32 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:28:32 user nova-compute[74892]: FIRMWARE:
Nov 15 14:28:32 user nova-compute[74892]: No targets found.
Nov 15 14:28:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:28:32 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:28:32 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d846e188-9c9f-47c2-abd8-8b0dc49f94bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62e23fb-33e3-4078-86a1-fb16cbca937a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:32 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:28:32 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:32 user nova-compute[74892]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 (non-flash)
Nov 15 14:28:32 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd4c7368c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22'): ({'sde'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Removing single pathed devices sde {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1ce0b3-20e4-40fd-bb58-7f7913cd6d70]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eced69a4-642c-4c0a-ab44-7e6250553b59]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Flushing IO for device /dev/sde {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e18f46-e534-443e-859b-3630df56f191]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b38dc8-8d5b-4cf8-a161-fb844aef447e]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64745ca-7b71-448d-8991-6d71ff5215ad]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f4228a-bc03-436b-8c59-5f2462f0008f]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22, portal: 172.16.0.220,3260]
Nov 15 14:28:32 user nova-compute[74892]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22, portal: 172.16.0.220,3260] successful.
Nov 15 14:28:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5330b2fc-675d-435e-a878-71ec42854e22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacca861-2fa5-4ab4-b50f-6d8145b828c9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] <== disconnect_volume: return (359ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updating instance_info_cache with network_info: [{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Releasing lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'flavor' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b2b483a9-89a9-41d8-8eef-5ac4ec99acc9 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.974s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-ac40e699-5687-4407-8ec1-f16c4acf5991 req-ef95b6a7-4b5d-4c47-a188-bd4660893d6a service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ac40e699-5687-4407-8ec1-f16c4acf5991 req-ef95b6a7-4b5d-4c47-a188-bd4660893d6a service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ac40e699-5687-4407-8ec1-f16c4acf5991 req-ef95b6a7-4b5d-4c47-a188-bd4660893d6a service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ac40e699-5687-4407-8ec1-f16c4acf5991 req-ef95b6a7-4b5d-4c47-a188-bd4660893d6a service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-ac40e699-5687-4407-8ec1-f16c4acf5991 req-ef95b6a7-4b5d-4c47-a188-bd4660893d6a service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:33 user nova-compute[74892]: WARNING nova.compute.manager [req-ac40e699-5687-4407-8ec1-f16c4acf5991 req-ef95b6a7-4b5d-4c47-a188-bd4660893d6a service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state building and task_state spawning.
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:28:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance spawned successfully.
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Instance destroyed successfully.
Nov 15 14:28:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Attempting rescue
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74892) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Instance directory exists: not creating {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 14:28:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Creating image(s)
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: INFO nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.217s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: INFO nova.compute.manager [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Took 19.37 seconds to build instance.
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-8e1f4fe3-36c3-4f42-8162-05992317745d tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.500s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue" returned: 0 in 0.062s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'migration_context' on Instance uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.base [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9a85430d-53e3-4181-9588-158654fe008d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Start _get_guest_xml network_info=[{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:74:40:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'resources' on Instance uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.base [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9a85430d-53e3-4181-9588-158654fe008d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'numa_topology' on Instance uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.base [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9a85430d-53e3-4181-9588-158654fe008d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:34 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:34 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.base [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9a85430d-53e3-4181-9588-158654fe008d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-929193431',display_name='tempest-ServerRescueNegativeTestJSON-server-929193431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-929193431',id=31,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:26:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-r2c185fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:53Z,user_data=None,user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=9a85430d-53e3-4181-9588-158654fe008d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:74:40:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:74:40:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:40:37,bridge_name='br-int',has_traffic_filtering=True,id=6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7d8cf2-83') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.objects.base [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9a85430d-53e3-4181-9588-158654fe008d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:28:34 user nova-compute[74892]:   <uuid>9a85430d-53e3-4181-9588-158654fe008d</uuid>
Nov 15 14:28:34 user nova-compute[74892]:   <name>instance-0000001f</name>
Nov 15 14:28:34 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:28:34 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:28:34 user nova-compute[74892]:   <metadata>
Nov 15 14:28:34 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:28:34 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:28:34 user nova-compute[74892]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-929193431</nova:name>
Nov 15 14:28:34 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:28:34</nova:creationTime>
Nov 15 14:28:34 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:28:34 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:28:34 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:28:34 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:28:34 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:28:34 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:28:34 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:28:34 user nova-compute[74892]:       <nova:owner>
Nov 15 14:28:34 user nova-compute[74892]:         <nova:user uuid="29fa0ea399dc4bafb5d2926ae76261c3">tempest-ServerRescueNegativeTestJSON-454831858-project-member</nova:user>
Nov 15 14:28:34 user nova-compute[74892]:         <nova:project uuid="16fe2666f7194df390f9764790c3663d">tempest-ServerRescueNegativeTestJSON-454831858</nova:project>
Nov 15 14:28:34 user nova-compute[74892]:       </nova:owner>
Nov 15 14:28:34 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:28:34 user nova-compute[74892]:       <nova:ports>
Nov 15 14:28:34 user nova-compute[74892]:         <nova:port uuid="6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b">
Nov 15 14:28:34 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 14:28:34 user nova-compute[74892]:         </nova:port>
Nov 15 14:28:34 user nova-compute[74892]:       </nova:ports>
Nov 15 14:28:34 user nova-compute[74892]:     </nova:instance>
Nov 15 14:28:34 user nova-compute[74892]:   </metadata>
Nov 15 14:28:34 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:28:34 user nova-compute[74892]:     <system>
Nov 15 14:28:34 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:28:34 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:28:34 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:28:34 user nova-compute[74892]:       <entry name="serial">9a85430d-53e3-4181-9588-158654fe008d</entry>
Nov 15 14:28:34 user nova-compute[74892]:       <entry name="uuid">9a85430d-53e3-4181-9588-158654fe008d</entry>
Nov 15 14:28:34 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:28:34 user nova-compute[74892]:     </system>
Nov 15 14:28:34 user nova-compute[74892]:   </sysinfo>
Nov 15 14:28:34 user nova-compute[74892]:   <os>
Nov 15 14:28:34 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:28:34 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:28:34 user nova-compute[74892]:   </os>
Nov 15 14:28:34 user nova-compute[74892]:   <features>
Nov 15 14:28:34 user nova-compute[74892]:     <acpi/>
Nov 15 14:28:34 user nova-compute[74892]:     <apic/>
Nov 15 14:28:34 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:28:34 user nova-compute[74892]:   </features>
Nov 15 14:28:34 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:28:34 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:28:34 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:28:34 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:28:34 user nova-compute[74892]:   </clock>
Nov 15 14:28:34 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:28:34 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:28:34 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:28:34 user nova-compute[74892]:   </cpu>
Nov 15 14:28:34 user nova-compute[74892]:   <devices>
Nov 15 14:28:34 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:28:34 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:28:34 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue"/>
Nov 15 14:28:34 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:28:34 user nova-compute[74892]:     </disk>
Nov 15 14:28:34 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:28:34 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:28:34 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk"/>
Nov 15 14:28:34 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:28:34 user nova-compute[74892]:     </disk>
Nov 15 14:28:34 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:28:34 user nova-compute[74892]:       <mac address="fa:16:3e:74:40:37"/>
Nov 15 14:28:34 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:34 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:28:34 user nova-compute[74892]:       <target dev="tap6e7d8cf2-83"/>
Nov 15 14:28:34 user nova-compute[74892]:     </interface>
Nov 15 14:28:34 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:28:34 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/console.log" append="off"/>
Nov 15 14:28:34 user nova-compute[74892]:     </serial>
Nov 15 14:28:34 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:28:34 user nova-compute[74892]:     <video>
Nov 15 14:28:34 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:34 user nova-compute[74892]:     </video>
Nov 15 14:28:34 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:28:34 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:28:34 user nova-compute[74892]:     </rng>
Nov 15 14:28:34 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:28:34 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:28:34 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:28:34 user nova-compute[74892]:     </memballoon>
Nov 15 14:28:34 user nova-compute[74892]:   </devices>
Nov 15 14:28:34 user nova-compute[74892]: </domain>
Nov 15 14:28:34 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:28:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Instance destroyed successfully.
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecZWpzvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:34 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:34 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:34 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No VIF found with MAC fa:16:3e:74:40:37, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca7786-93d4-456c-9c7e-f16bfd33cb8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:28:34 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc6c31-10d7-4873-bc96-24cfb3592d9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e] added
Nov 15 14:28:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0132e137-8a15-4f98-a981-5d3c5512bac8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee416c69-aa5b-46d1-8a49-134bfc4cbb08]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecZWpzvS {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ecZWpzvS" returned: 0 in 0.130s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d73f6-d8ac-466e-9df0-81358032a686]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ecZWpzvS'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c377b44-977c-4db1-b98b-619850848d52]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[da33c323-69bb-4bd7-b475-951db4bf0e14]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:34 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:34 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:28:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Creating image(s)
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Ensure instance console log exists: /opt/stack/data/nova/instances/1b456afe-f03e-4856-aa42-634959e5547d/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Start _get_guest_xml network_info=[{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQyDsgUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b456afe-f03e-4856-aa42-634959e5547d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7463944-aa87-4fae-9e85-4ec46ba5038f', 'serial': 'f7463944-aa87-4fae-9e85-4ec46ba5038f'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '1bfc15ae-7667-48d8-88d4-bf3a4dbbde53', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:28:34 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:34 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQyDsgUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:34 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc71944-3292-49d8-a168-f11b8c230b06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e, portal: 172.16.0.220,3260]
Nov 15 14:28:34 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e, portal: 172.16.0.220,3260] successful.
Nov 15 14:28:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9e3d23-6c9e-43be-9338-81ecd9f8463f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9f4948-0cab-44b1-a4b1-0ca1130977f4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:35 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:35 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:35 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:35 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:35 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:35 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.511s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b4f73-b529-46ad-a1aa-5944b274f774]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:28:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-77816741-d3ad-4991-afc7-5c5772ac204c req-db8e1f3e-d985-42eb-990c-c91d25691482 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-unplugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-77816741-d3ad-4991-afc7-5c5772ac204c req-db8e1f3e-d985-42eb-990c-c91d25691482 service nova] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-77816741-d3ad-4991-afc7-5c5772ac204c req-db8e1f3e-d985-42eb-990c-c91d25691482 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-77816741-d3ad-4991-afc7-5c5772ac204c req-db8e1f3e-d985-42eb-990c-c91d25691482 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-77816741-d3ad-4991-afc7-5c5772ac204c req-db8e1f3e-d985-42eb-990c-c91d25691482 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] No waiting events found dispatching network-vif-unplugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:36 user nova-compute[74892]: WARNING nova.compute.manager [req-77816741-d3ad-4991-afc7-5c5772ac204c req-db8e1f3e-d985-42eb-990c-c91d25691482 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received unexpected event network-vif-unplugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b for instance with vm_state active and task_state rescuing.
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecZWpzvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] <== connect_volume: return (1545ms) {'type': 'block', 'scsi_wwn': '23535613031636433', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535613031636433', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.096s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:36 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:36 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e81281-5816-48c9-aaaa-8bc405a55c3d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:28:36 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG nova.objects.instance [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lazy-loading 'flavor' on Instance uuid e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.040s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d2289d-dea4-4f9d-9c2d-c0abafd9e347]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f] added
Nov 15 14:28:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f99b6-1ee2-4e1b-9d80-8aafe2c5a7ae]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:28:36 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:36 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:28:36 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:28:36 user nova-compute[74892]:   <serial>7509c7c6-8a33-4549-b8c6-108f5d04b02e</serial>
Nov 15 14:28:36 user nova-compute[74892]: </disk>
Nov 15 14:28:36 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6612479-a7e5-432a-8d61-9e3e21959467]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQyDsgUR {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQyDsgUR" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d82c7a4-b0c1-4298-a1eb-afff83f0c41e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tQyDsgUR'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6164bf5c-5b6a-4e48-b29d-992453315f4e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[39939b3d-2f3c-4820-bafa-031592dd1b72]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9a854d-8ceb-460a-ae72-810bfca68ece]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260]
Nov 15 14:28:36 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260] successful.
Nov 15 14:28:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8aa63d0-0675-439a-8698-f3bb3088e387]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4565ef4f-ed27-4ff0-ba79-307e46fff4b3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:36 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.501s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.046s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[495936cd-8829-49ae-8353-39be7e6ca8c2]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQyDsgUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:28:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No VIF found with MAC fa:16:3e:25:c2:26, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e99d35fe-9590-46b1-aae0-928acb70ddc9 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.254s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.584s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== connect_volume: return (2680ms) {'type': 'block', 'scsi_wwn': '23865663765326133', 'path': '/dev/sde'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663765326133', 'path': '/dev/sde'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836258062',display_name='tempest-ServerActionsTestOtherA-server-1836258062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836258062',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-tgmqdx1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=1b456afe-f03e-4856-aa42-634959e5547d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b456afe-f03e-4856-aa42-634959e5547d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:28:37 user nova-compute[74892]:   <uuid>1b456afe-f03e-4856-aa42-634959e5547d</uuid>
Nov 15 14:28:37 user nova-compute[74892]:   <name>instance-00000023</name>
Nov 15 14:28:37 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:28:37 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:28:37 user nova-compute[74892]:   <metadata>
Nov 15 14:28:37 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:28:37 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:28:37 user nova-compute[74892]:       <nova:name>tempest-ServerActionsTestOtherA-server-1836258062</nova:name>
Nov 15 14:28:37 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:28:34</nova:creationTime>
Nov 15 14:28:37 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:28:37 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:28:37 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:28:37 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:28:37 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:28:37 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:28:37 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:28:37 user nova-compute[74892]:       <nova:owner>
Nov 15 14:28:37 user nova-compute[74892]:         <nova:user uuid="abe166e9b6134abf85db0e21ec1e100d">tempest-ServerActionsTestOtherA-2044893964-project-member</nova:user>
Nov 15 14:28:37 user nova-compute[74892]:         <nova:project uuid="bbe544848b48449381967e24f274b7bd">tempest-ServerActionsTestOtherA-2044893964</nova:project>
Nov 15 14:28:37 user nova-compute[74892]:       </nova:owner>
Nov 15 14:28:37 user nova-compute[74892]:       <nova:ports>
Nov 15 14:28:37 user nova-compute[74892]:         <nova:port uuid="90e29962-319e-43d8-b270-26d1859d0d36">
Nov 15 14:28:37 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:28:37 user nova-compute[74892]:         </nova:port>
Nov 15 14:28:37 user nova-compute[74892]:       </nova:ports>
Nov 15 14:28:37 user nova-compute[74892]:     </nova:instance>
Nov 15 14:28:37 user nova-compute[74892]:   </metadata>
Nov 15 14:28:37 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:28:37 user nova-compute[74892]:     <system>
Nov 15 14:28:37 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:28:37 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:28:37 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:28:37 user nova-compute[74892]:       <entry name="serial">1b456afe-f03e-4856-aa42-634959e5547d</entry>
Nov 15 14:28:37 user nova-compute[74892]:       <entry name="uuid">1b456afe-f03e-4856-aa42-634959e5547d</entry>
Nov 15 14:28:37 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:28:37 user nova-compute[74892]:     </system>
Nov 15 14:28:37 user nova-compute[74892]:   </sysinfo>
Nov 15 14:28:37 user nova-compute[74892]:   <os>
Nov 15 14:28:37 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:28:37 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:28:37 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:28:37 user nova-compute[74892]:   </os>
Nov 15 14:28:37 user nova-compute[74892]:   <features>
Nov 15 14:28:37 user nova-compute[74892]:     <acpi/>
Nov 15 14:28:37 user nova-compute[74892]:     <apic/>
Nov 15 14:28:37 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:28:37 user nova-compute[74892]:   </features>
Nov 15 14:28:37 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:28:37 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:28:37 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:28:37 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:28:37 user nova-compute[74892]:   </clock>
Nov 15 14:28:37 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:28:37 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:28:37 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:28:37 user nova-compute[74892]:   </cpu>
Nov 15 14:28:37 user nova-compute[74892]:   <devices>
Nov 15 14:28:37 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:28:37 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:37 user nova-compute[74892]:       <source dev="/dev/sde"/>
Nov 15 14:28:37 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:28:37 user nova-compute[74892]:       <serial>f7463944-aa87-4fae-9e85-4ec46ba5038f</serial>
Nov 15 14:28:37 user nova-compute[74892]:     </disk>
Nov 15 14:28:37 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:28:37 user nova-compute[74892]:       <mac address="fa:16:3e:81:3e:de"/>
Nov 15 14:28:37 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:37 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:28:37 user nova-compute[74892]:       <target dev="tap90e29962-31"/>
Nov 15 14:28:37 user nova-compute[74892]:     </interface>
Nov 15 14:28:37 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:28:37 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/1b456afe-f03e-4856-aa42-634959e5547d/console.log" append="off"/>
Nov 15 14:28:37 user nova-compute[74892]:     </serial>
Nov 15 14:28:37 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:28:37 user nova-compute[74892]:     <video>
Nov 15 14:28:37 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:28:37 user nova-compute[74892]:     </video>
Nov 15 14:28:37 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:28:37 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:28:37 user nova-compute[74892]:     </rng>
Nov 15 14:28:37 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:28:37 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:28:37 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:28:37 user nova-compute[74892]:     </memballoon>
Nov 15 14:28:37 user nova-compute[74892]:   </devices>
Nov 15 14:28:37 user nova-compute[74892]: </domain>
Nov 15 14:28:37 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836258062',display_name='tempest-ServerActionsTestOtherA-server-1836258062',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836258062',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-tgmqdx1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=1b456afe-f03e-4856-aa42-634959e5547d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG os_vif [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d9f8db1-6dc7-5086-8bb5-4a8b26ca25bf', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90e29962-31, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90e29962-31, col_values=(('qos', UUID('fc1e50f7-dc5c-4b6d-9917-8ef5056f44df')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90e29962-31, col_values=(('external_ids', {'iface-id': '90e29962-319e-43d8-b270-26d1859d0d36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:3e:de', 'vm-uuid': '1b456afe-f03e-4856-aa42-634959e5547d'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:37 user nova-compute[74892]: INFO os_vif [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31')
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No VIF found with MAC fa:16:3e:81:3e:de, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:28:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] No waiting events found dispatching network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:38 user nova-compute[74892]: WARNING nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received unexpected event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b for instance with vm_state active and task_state rescuing.
Nov 15 14:28:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] No waiting events found dispatching network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:38 user nova-compute[74892]: WARNING nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received unexpected event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b for instance with vm_state active and task_state rescuing.
Nov 15 14:28:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] No waiting events found dispatching network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:38 user nova-compute[74892]: WARNING nova.compute.manager [req-af93f928-d419-4373-958d-04922b6b3cb4 req-5eb44f0c-f57f-4ff2-ba14-4d458f975472 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received unexpected event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b for instance with vm_state active and task_state rescuing.
Nov 15 14:28:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d0df8ea0-e1f6-4fc6-8303-67e0e1553c03 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:28:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] No waiting events found dispatching network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:40 user nova-compute[74892]: WARNING nova.compute.manager [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received unexpected event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 for instance with vm_state building and task_state spawning.
Nov 15 14:28:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] No waiting events found dispatching network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:28:40 user nova-compute[74892]: WARNING nova.compute.manager [req-19960866-ee0f-480b-971f-00b6f9326f7b req-94bfe901-7611-4fe7-ac50-3f2132ae45f5 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received unexpected event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 for instance with vm_state building and task_state spawning.
Nov 15 14:28:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:28:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance spawned successfully.
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:28:42 user nova-compute[74892]: INFO nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Took 7.33 seconds to spawn the instance on the hypervisor.
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:28:42 user nova-compute[74892]: INFO nova.compute.manager [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Took 19.82 seconds to build instance.
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0cd4b642-8d19-4973-b611-8994684c22a2 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.168s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.objects.instance [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lazy-loading 'flavor' on Instance uuid e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:42 user nova-compute[74892]: INFO nova.compute.manager [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Attaching volume abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 to /dev/vdc
Nov 15 14:28:42 user nova-compute[74892]: DEBUG os_brick.utils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6d7147-2c5b-419b-b9fa-6c7f824e1af3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:42 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd13995-9bb7-4492-8ac1-e0870c10bce8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbecfc94-f35f-4cde-83cb-a9eccf04ccbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[030c54e6-4a79-4ddd-b329-2ec75666000d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:43 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[35477ec9-0186-4723-a320-185d3d37336c]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] <== get_connector_properties: return (301ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Updating existing volume attachment record: 1eb33600-a2b5-446e-8034-a27193069dd9 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-6bc28937-0c98-4c42-bad5-f4de444dc925 req-f2bcce45-56c0-4af5-b5f5-3e9d363dc187 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received event network-changed-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-6bc28937-0c98-4c42-bad5-f4de444dc925 req-f2bcce45-56c0-4af5-b5f5-3e9d363dc187 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Refreshing instance network info cache due to event network-changed-dfc68ead-0105-4466-ba6e-ca32744c0fe8. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6bc28937-0c98-4c42-bad5-f4de444dc925 req-f2bcce45-56c0-4af5-b5f5-3e9d363dc187 service nova] Acquiring lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6bc28937-0c98-4c42-bad5-f4de444dc925 req-f2bcce45-56c0-4af5-b5f5-3e9d363dc187 service nova] Acquired lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-6bc28937-0c98-4c42-bad5-f4de444dc925 req-f2bcce45-56c0-4af5-b5f5-3e9d363dc187 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Refreshing network info cache for port dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.objects.instance [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'flavor' on Instance uuid 532ff00e-4e44-4749-bc09-b5938b073005 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:44 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Ignoring supplied device name: /dev/vdb
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:44 user nova-compute[74892]: INFO nova.compute.manager [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Attaching volume 39da3aca-e6d9-49d9-9d26-ea4225f52869 to /dev/vdb
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG os_brick.utils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-6bc28937-0c98-4c42-bad5-f4de444dc925 req-f2bcce45-56c0-4af5-b5f5-3e9d363dc187 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Updated VIF entry in instance network info cache for port dfc68ead-0105-4466-ba6e-ca32744c0fe8. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.network.neutron [req-6bc28937-0c98-4c42-bad5-f4de444dc925 req-f2bcce45-56c0-4af5-b5f5-3e9d363dc187 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Updating instance_info_cache with network_info: [{"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[691389d0-641a-4f4b-b9fa-c6ba0ba72448]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6bc28937-0c98-4c42-bad5-f4de444dc925 req-f2bcce45-56c0-4af5-b5f5-3e9d363dc187 service nova] Releasing lock "refresh_cache-532ff00e-4e44-4749-bc09-b5938b073005" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf36828-b366-4526-aaef-28d860c63dbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[341ec50a-b815-4f96-9b7e-5c0036ed3a4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1113ed-2fd9-4462-81d3-03a9077c0d34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:44 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:28:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8c2941-b1bc-4012-99c5-501c40838337]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG os_brick.utils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:44 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Updating existing volume attachment record: 0f969860-497f-4dff-bf25-91880e4c0e2a {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.249s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:28:46 user nova-compute[74892]: INFO nova.compute.claims [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Claim successful on node user
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.968s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:28:47 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:28:47 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:28:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG nova.policy [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c73da782783d41dbb370c3df04dec208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdd6323d06f4337995cbb796778b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:28:48 user nova-compute[74892]: INFO nova.virt.block_device [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Booting with volume snapshot 852a1963-faff-4ed8-b363-e44321dc38ec at /dev/vda
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Successfully created port: 0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Successfully updated port: 0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-7154deba-0c41-4693-961a-f0dc24feb7b2 req-19c07cd3-e8ec-4717-905d-8d4bcd081048 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received event network-changed-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-7154deba-0c41-4693-961a-f0dc24feb7b2 req-19c07cd3-e8ec-4717-905d-8d4bcd081048 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Refreshing instance network info cache due to event network-changed-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7154deba-0c41-4693-961a-f0dc24feb7b2 req-19c07cd3-e8ec-4717-905d-8d4bcd081048 service nova] Acquiring lock "refresh_cache-f24a0e1a-d0e9-4db0-81cd-b246970759c4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7154deba-0c41-4693-961a-f0dc24feb7b2 req-19c07cd3-e8ec-4717-905d-8d4bcd081048 service nova] Acquired lock "refresh_cache-f24a0e1a-d0e9-4db0-81cd-b246970759c4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.network.neutron [req-7154deba-0c41-4693-961a-f0dc24feb7b2 req-19c07cd3-e8ec-4717-905d-8d4bcd081048 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Refreshing network info cache for port 0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTcIrptE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:49 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:49 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:49 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "refresh_cache-f24a0e1a-d0e9-4db0-81cd-b246970759c4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7319MB free_disk=24.8460693359375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c7a365-15f8-4db5-9170-946957897b39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:28:49 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9523b-b4ea-4492-8380-ca87e7978b5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4] added
Nov 15 14:28:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb4ec08-5bac-4377-bea0-5878c1bc5898]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.network.neutron [req-7154deba-0c41-4693-961a-f0dc24feb7b2 req-19c07cd3-e8ec-4717-905d-8d4bcd081048 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b23fa5-c809-4251-97b5-658341c05c54]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eTcIrptE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eTcIrptE" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[46172fd5-6688-45b5-bd84-86c2ee3e32fc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eTcIrptE'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9008dae5-e537-4869-855b-9608d241229b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e68044-b2a2-475c-85f7-c8df2b1fe316]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:49 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:49 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:49 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:49 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:49 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:49 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9e258725-b58a-46c8-a2f0-099e246564a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e9693214-e0c7-45c0-9542-3171b45712b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 532ff00e-4e44-4749-bc09-b5938b073005 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 5267e3dc-3c08-4046-836c-6ac540f0476d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 144bf11d-fc91-4bcb-9c63-3e11b3d8661b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1b456afe-f03e-4856-aa42-634959e5547d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance f24a0e1a-d0e9-4db0-81cd-b246970759c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:28:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7bab7b-1407-4aa5-8aed-efaf62329580]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4, portal: 172.16.0.220,3260]
Nov 15 14:28:50 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4, portal: 172.16.0.220,3260] successful.
Nov 15 14:28:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8c3cca-dcdc-4a4f-b7b6-69bfb4da0ab5]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2c61fe-3bde-4280-8a3a-ed96c7298d77]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:50 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:50 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:50 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:50 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:28:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:50 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:50 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:50 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:50 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:28:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee67a81-d42d-4c0e-84cb-12b939fbbe40]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTcIrptE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.network.neutron [req-7154deba-0c41-4693-961a-f0dc24feb7b2 req-19c07cd3-e8ec-4717-905d-8d4bcd081048 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7154deba-0c41-4693-961a-f0dc24feb7b2 req-19c07cd3-e8ec-4717-905d-8d4bcd081048 service nova] Releasing lock "refresh_cache-f24a0e1a-d0e9-4db0-81cd-b246970759c4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquired lock "refresh_cache-f24a0e1a-d0e9-4db0-81cd-b246970759c4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Updating instance_info_cache with network_info: [{"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.780s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Releasing lock "refresh_cache-f24a0e1a-d0e9-4db0-81cd-b246970759c4" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Instance network_info: |[{"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBnEtCid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:50 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26437353937613766', 'path': '/dev/sdf'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437353937613766', 'path': '/dev/sdf'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.200s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:51 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:28:51 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG nova.objects.instance [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lazy-loading 'flavor' on Instance uuid e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edab534-dbdd-48a2-8e5d-e793ea29afc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:28:51 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:28:51 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:51 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:28:51 user nova-compute[74892]:   <target dev="vdc" bus="virtio"/>
Nov 15 14:28:51 user nova-compute[74892]:   <serial>abc8ed46-2c0c-46b8-9e30-e89c7d4154c4</serial>
Nov 15 14:28:51 user nova-compute[74892]: </disk>
Nov 15 14:28:51 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe23cb8-1b67-4b43-9746-4ae0dbb1b476]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869] added
Nov 15 14:28:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f63f8f9-1930-44ba-8bf8-84567d4f97da]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[599d131c-4f14-4f5f-a3ef-16c9cbf5cc6a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBnEtCid {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBnEtCid" returned: 0 in 0.090s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed34783e-4f3d-468f-88e0-0576275d4919]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YBnEtCid'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[534aa0b5-f422-4cf6-bb8f-b2b20aa3a80f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[28910ac7-295d-430b-8e3d-b7b89ada40b3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:51 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:51 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:51 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:51 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:28:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:51 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:51 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:51 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:51 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:28:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] No VIF found with MAC fa:16:3e:25:c2:26, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-69ac6920-a782-409f-a88b-c78c14383de2 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.029s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:52 user nova-compute[74892]: INFO nova.compute.manager [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Detaching volume abc8ed46-2c0c-46b8-9e30-e89c7d4154c4
Nov 15 14:28:52 user nova-compute[74892]: INFO nova.virt.block_device [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Attempting to driver detach volume abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 from mountpoint /dev/vdc
Nov 15 14:28:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Attempting to detach device vdc from instance e9693214-e0c7-45c0-9542-3171b45712b4 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:28:52 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:52 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:28:52 user nova-compute[74892]:   <target dev="vdc" bus="virtio"/>
Nov 15 14:28:52 user nova-compute[74892]:   <serial>abc8ed46-2c0c-46b8-9e30-e89c7d4154c4</serial>
Nov 15 14:28:52 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 14:28:52 user nova-compute[74892]: </disk>
Nov 15 14:28:52 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:28:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Successfully detached device vdc from instance e9693214-e0c7-45c0-9542-3171b45712b4 from the persistent domain config.
Nov 15 14:28:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e9693214-e0c7-45c0-9542-3171b45712b4 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:28:52 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:52 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:28:52 user nova-compute[74892]:   <target dev="vdc" bus="virtio"/>
Nov 15 14:28:52 user nova-compute[74892]:   <serial>abc8ed46-2c0c-46b8-9e30-e89c7d4154c4</serial>
Nov 15 14:28:52 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 14:28:52 user nova-compute[74892]: </disk>
Nov 15 14:28:52 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --login" returned: 0 in 1.072s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce65eed-2b30-44ec-a99d-b7ce46eb95de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869, portal: 172.16.0.220,3260]
Nov 15 14:28:52 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869, portal: 172.16.0.220,3260] successful.
Nov 15 14:28:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8253b4ea-db43-4ff3-918d-f5efcb08f451]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d1a955-a804-4665-85fd-f8b45c2f4049]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:28:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:28:52 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:28:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.390s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd5f697-b519-46c6-862f-a367f9c8f4a4]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBnEtCid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:28:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.432s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:28:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] <== connect_volume: return (2632ms) {'type': 'block', 'scsi_wwn': '26533613664653339', 'path': '/dev/sdg'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533613664653339', 'path': '/dev/sdg'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:28:53 user nova-compute[74892]: DEBUG nova.objects.instance [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'flavor' on Instance uuid 532ff00e-4e44-4749-bc09-b5938b073005 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:28:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:28:53 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:28:53 user nova-compute[74892]:   <source dev="/dev/sdg"/>
Nov 15 14:28:53 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:28:53 user nova-compute[74892]:   <serial>39da3aca-e6d9-49d9-9d26-ea4225f52869</serial>
Nov 15 14:28:53 user nova-compute[74892]: </disk>
Nov 15 14:28:53 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] No VIF found with MAC fa:16:3e:6c:60:43, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG os_brick.utils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[136bbae6-301f-4df1-9cfc-57187a648098]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adbe89d-1ddd-4395-9534-d36f1e806e99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7806f85f-557f-4be8-97cd-8948eb14b0e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc11c739-528a-43e8-ae14-2430e131c998]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:28:54 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-91288e81-b0d2-4a4e-a22b-a9319a90e9fa tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.506s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee5919-d2ce-43a5-bcff-40dbe021a95e]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG os_brick.utils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:28:54 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Updating existing volume attachment record: 3c791f1d-e0ae-4d0e-ba4b-374b59b1f4cd {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:28:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:28:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:28:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:28:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:28:59 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Creating image(s)
Nov 15 14:28:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:28:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Ensure instance console log exists: /opt/stack/data/nova/instances/f24a0e1a-d0e9-4db0-81cd-b246970759c4/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:28:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:28:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:28:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:28:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Start _get_guest_xml network_info=[{"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOJcRwBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f24a0e1a-d0e9-4db0-81cd-b246970759c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc04b894-2178-413a-b83d-871a424fc932', 'serial': 'bc04b894-2178-413a-b83d-871a424fc932'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '3c791f1d-e0ae-4d0e-ba4b-374b59b1f4cd', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:29:00 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:29:00 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOJcRwBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:29:00 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:29:00 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:29:00 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81594b9-1706-4fde-b352-702466a469c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:29:00 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[20549b53-c3c4-4dd0-af99-010572d0544d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932] added
Nov 15 14:29:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[83176580-86d7-471d-84e9-07d01f96e9fa]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a724f97-bb0c-42cb-ab8d-c19bd7e14a2a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOJcRwBg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOJcRwBg" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b78b20-e6cd-415c-80b2-a5aff51233fb]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XOJcRwBg'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a932a3-a92f-423e-beab-3119dafb617e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff41f46-236a-4027-b99f-a3fb309aba3c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3099c4-e8d4-4b8d-81ab-c7b434115a7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932, portal: 172.16.0.220,3260]
Nov 15 14:29:00 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932, portal: 172.16.0.220,3260] successful.
Nov 15 14:29:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f532652-a1b2-4602-b684-953f3dbbbe22]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9656662-66a3-4339-8399-9941ffbacd48]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:29:00 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] HCTL ('39', '-', '-', 0) found on session 39 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab55a6d-66d9-45fe-b02d-fdce49b02e0b]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching for a device in session 39 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:29:00 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOJcRwBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23036373730373361', 'path': '/dev/sdh'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036373730373361', 'path': '/dev/sdh'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2100931145',display_name='tempest-TestVolumeBootPattern-server-2100931145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2100931145',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-qpzezhrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:48Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=f24a0e1a-d0e9-4db0-81cd-b246970759c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5b:d9,bridge_name='br-int',has_traffic_filtering=True,id=0efd9ad5-e4eb-46b0-bc56-4effcf7647ae,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efd9ad5-e4') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'pci_devices' on Instance uuid f24a0e1a-d0e9-4db0-81cd-b246970759c4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:29:01 user nova-compute[74892]:   <uuid>f24a0e1a-d0e9-4db0-81cd-b246970759c4</uuid>
Nov 15 14:29:01 user nova-compute[74892]:   <name>instance-00000024</name>
Nov 15 14:29:01 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:29:01 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:29:01 user nova-compute[74892]:   <metadata>
Nov 15 14:29:01 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:29:01 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:29:01 user nova-compute[74892]:       <nova:name>tempest-TestVolumeBootPattern-server-2100931145</nova:name>
Nov 15 14:29:01 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:29:00</nova:creationTime>
Nov 15 14:29:01 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:29:01 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:29:01 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:29:01 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:29:01 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:29:01 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:29:01 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:29:01 user nova-compute[74892]:       <nova:owner>
Nov 15 14:29:01 user nova-compute[74892]:         <nova:user uuid="c73da782783d41dbb370c3df04dec208">tempest-TestVolumeBootPattern-1799633332-project-member</nova:user>
Nov 15 14:29:01 user nova-compute[74892]:         <nova:project uuid="1cdd6323d06f4337995cbb796778b449">tempest-TestVolumeBootPattern-1799633332</nova:project>
Nov 15 14:29:01 user nova-compute[74892]:       </nova:owner>
Nov 15 14:29:01 user nova-compute[74892]:       <nova:ports>
Nov 15 14:29:01 user nova-compute[74892]:         <nova:port uuid="0efd9ad5-e4eb-46b0-bc56-4effcf7647ae">
Nov 15 14:29:01 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:29:01 user nova-compute[74892]:         </nova:port>
Nov 15 14:29:01 user nova-compute[74892]:       </nova:ports>
Nov 15 14:29:01 user nova-compute[74892]:     </nova:instance>
Nov 15 14:29:01 user nova-compute[74892]:   </metadata>
Nov 15 14:29:01 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:29:01 user nova-compute[74892]:     <system>
Nov 15 14:29:01 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:29:01 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:29:01 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:29:01 user nova-compute[74892]:       <entry name="serial">f24a0e1a-d0e9-4db0-81cd-b246970759c4</entry>
Nov 15 14:29:01 user nova-compute[74892]:       <entry name="uuid">f24a0e1a-d0e9-4db0-81cd-b246970759c4</entry>
Nov 15 14:29:01 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:29:01 user nova-compute[74892]:     </system>
Nov 15 14:29:01 user nova-compute[74892]:   </sysinfo>
Nov 15 14:29:01 user nova-compute[74892]:   <os>
Nov 15 14:29:01 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:29:01 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:29:01 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:29:01 user nova-compute[74892]:   </os>
Nov 15 14:29:01 user nova-compute[74892]:   <features>
Nov 15 14:29:01 user nova-compute[74892]:     <acpi/>
Nov 15 14:29:01 user nova-compute[74892]:     <apic/>
Nov 15 14:29:01 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:29:01 user nova-compute[74892]:   </features>
Nov 15 14:29:01 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:29:01 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:29:01 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:29:01 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:29:01 user nova-compute[74892]:   </clock>
Nov 15 14:29:01 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:29:01 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:29:01 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:29:01 user nova-compute[74892]:   </cpu>
Nov 15 14:29:01 user nova-compute[74892]:   <devices>
Nov 15 14:29:01 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:29:01 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:29:01 user nova-compute[74892]:       <source dev="/dev/sdh"/>
Nov 15 14:29:01 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:29:01 user nova-compute[74892]:       <serial>bc04b894-2178-413a-b83d-871a424fc932</serial>
Nov 15 14:29:01 user nova-compute[74892]:     </disk>
Nov 15 14:29:01 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:29:01 user nova-compute[74892]:       <mac address="fa:16:3e:3f:5b:d9"/>
Nov 15 14:29:01 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:29:01 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:29:01 user nova-compute[74892]:       <target dev="tap0efd9ad5-e4"/>
Nov 15 14:29:01 user nova-compute[74892]:     </interface>
Nov 15 14:29:01 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:29:01 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/f24a0e1a-d0e9-4db0-81cd-b246970759c4/console.log" append="off"/>
Nov 15 14:29:01 user nova-compute[74892]:     </serial>
Nov 15 14:29:01 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:29:01 user nova-compute[74892]:     <video>
Nov 15 14:29:01 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:29:01 user nova-compute[74892]:     </video>
Nov 15 14:29:01 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:29:01 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:29:01 user nova-compute[74892]:     </rng>
Nov 15 14:29:01 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:29:01 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:29:01 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:29:01 user nova-compute[74892]:     </memballoon>
Nov 15 14:29:01 user nova-compute[74892]:   </devices>
Nov 15 14:29:01 user nova-compute[74892]: </domain>
Nov 15 14:29:01 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2100931145',display_name='tempest-TestVolumeBootPattern-server-2100931145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2100931145',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-qpzezhrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:48Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=f24a0e1a-d0e9-4db0-81cd-b246970759c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5b:d9,bridge_name='br-int',has_traffic_filtering=True,id=0efd9ad5-e4eb-46b0-bc56-4effcf7647ae,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efd9ad5-e4') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG os_vif [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5b:d9,bridge_name='br-int',has_traffic_filtering=True,id=0efd9ad5-e4eb-46b0-bc56-4effcf7647ae,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efd9ad5-e4') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9894f54-d834-54fc-92c8-06a70f42746e', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0efd9ad5-e4, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0efd9ad5-e4, col_values=(('qos', UUID('1cd94c8e-bd5d-4eb7-93b5-d4856e3ea3d5')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0efd9ad5-e4, col_values=(('external_ids', {'iface-id': '0efd9ad5-e4eb-46b0-bc56-4effcf7647ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:5b:d9', 'vm-uuid': 'f24a0e1a-d0e9-4db0-81cd-b246970759c4'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:01 user nova-compute[74892]: INFO os_vif [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5b:d9,bridge_name='br-int',has_traffic_filtering=True,id=0efd9ad5-e4eb-46b0-bc56-4effcf7647ae,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efd9ad5-e4')
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No VIF found with MAC fa:16:3e:3f:5b:d9, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:29:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:02 user nova-compute[74892]: INFO nova.compute.manager [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Terminating instance
Nov 15 14:29:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-4ed3c96c-923e-4ed9-b886-7a6736589b61 req-b89593fd-d6af-4a87-912d-d0522f6f34a0 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4ed3c96c-923e-4ed9-b886-7a6736589b61 req-b89593fd-d6af-4a87-912d-d0522f6f34a0 service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4ed3c96c-923e-4ed9-b886-7a6736589b61 req-b89593fd-d6af-4a87-912d-d0522f6f34a0 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4ed3c96c-923e-4ed9-b886-7a6736589b61 req-b89593fd-d6af-4a87-912d-d0522f6f34a0 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-4ed3c96c-923e-4ed9-b886-7a6736589b61 req-b89593fd-d6af-4a87-912d-d0522f6f34a0 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-4ed3c96c-923e-4ed9-b886-7a6736589b61 req-b89593fd-d6af-4a87-912d-d0522f6f34a0 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-unplugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-06f64065-576b-455b-8c7a-21b2f7b39b1f req-49488f47-3980-4e2c-b822-1ad60797164b service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received event network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-06f64065-576b-455b-8c7a-21b2f7b39b1f req-49488f47-3980-4e2c-b822-1ad60797164b service nova] Acquiring lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-06f64065-576b-455b-8c7a-21b2f7b39b1f req-49488f47-3980-4e2c-b822-1ad60797164b service nova] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-06f64065-576b-455b-8c7a-21b2f7b39b1f req-49488f47-3980-4e2c-b822-1ad60797164b service nova] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-06f64065-576b-455b-8c7a-21b2f7b39b1f req-49488f47-3980-4e2c-b822-1ad60797164b service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] No waiting events found dispatching network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:03 user nova-compute[74892]: WARNING nova.compute.manager [req-06f64065-576b-455b-8c7a-21b2f7b39b1f req-49488f47-3980-4e2c-b822-1ad60797164b service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received unexpected event network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae for instance with vm_state building and task_state spawning.
Nov 15 14:29:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Instance destroyed successfully.
Nov 15 14:29:03 user nova-compute[74892]: DEBUG nova.objects.instance [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lazy-loading 'resources' on Instance uuid 9e258725-b58a-46c8-a2f0-099e246564a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1081380142',display_name='tempest-ServerStableDeviceRescueTest-server-1081380142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1081380142',id=21,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOEreWdSOh9C27OYv86KjUTql4Rj3DRrNfHz2wGjnrubcIDTk0yVVpeP/AIl3K9epUmRd45ekF5xJFn1eG0oe7Xow4qhLkHUh7OeXBDj2B+4tbr9ZyTAif/+eLweDmR0Q==',key_name='tempest-keypair-1042147050',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:25:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d0ace93cdac442c087c0ee565ce6d91f',ramdisk_id='',reservation_id='r-k69uypdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1573183010',owner_user_name='tempest-ServerStableDeviceRescueTest-1573183010-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:27:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2d08093aaa041d19f085ff9b5f822db',uuid=9e258725-b58a-46c8-a2f0-099e246564a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Converting VIF {"id": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "address": "fa:16:3e:13:dd:80", "network": {"id": "0f9ef846-aa53-4f02-bdfd-7400a9942de4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1726571561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d0ace93cdac442c087c0ee565ce6d91f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5b32a8-6a", "ovs_interfaceid": "ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:dd:80,bridge_name='br-int',has_traffic_filtering=True,id=ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6,network=Network(0f9ef846-aa53-4f02-bdfd-7400a9942de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5b32a8-6a') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG os_vif [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:dd:80,bridge_name='br-int',has_traffic_filtering=True,id=ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6,network=Network(0f9ef846-aa53-4f02-bdfd-7400a9942de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5b32a8-6a') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec5b32a8-6a, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84a4d64f-a670-432e-a8ed-1ce92efca0f1) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:03 user nova-compute[74892]: INFO os_vif [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:dd:80,bridge_name='br-int',has_traffic_filtering=True,id=ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6,network=Network(0f9ef846-aa53-4f02-bdfd-7400a9942de4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5b32a8-6a')
Nov 15 14:29:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Deleting instance files /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6_del
Nov 15 14:29:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Deletion of /opt/stack/data/nova/instances/9e258725-b58a-46c8-a2f0-099e246564a6_del complete
Nov 15 14:29:03 user nova-compute[74892]: INFO nova.compute.manager [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 15 14:29:03 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:29:03 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:29:04 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:29:04 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Took 0.89 seconds to deallocate network for instance.
Nov 15 14:29:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-8716c630-d9f3-4741-99e2-4ad8479a61e7 req-8e895419-7240-4095-9ce4-450580bc1c99 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8716c630-d9f3-4741-99e2-4ad8479a61e7 req-8e895419-7240-4095-9ce4-450580bc1c99 service nova] Acquiring lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8716c630-d9f3-4741-99e2-4ad8479a61e7 req-8e895419-7240-4095-9ce4-450580bc1c99 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8716c630-d9f3-4741-99e2-4ad8479a61e7 req-8e895419-7240-4095-9ce4-450580bc1c99 service nova] Lock "9e258725-b58a-46c8-a2f0-099e246564a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-8716c630-d9f3-4741-99e2-4ad8479a61e7 req-8e895419-7240-4095-9ce4-450580bc1c99 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] No waiting events found dispatching network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:04 user nova-compute[74892]: WARNING nova.compute.manager [req-8716c630-d9f3-4741-99e2-4ad8479a61e7 req-8e895419-7240-4095-9ce4-450580bc1c99 service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received unexpected event network-vif-plugged-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 for instance with vm_state deleted and task_state None.
Nov 15 14:29:04 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:29:04 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:05 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Deleted allocations for instance 9e258725-b58a-46c8-a2f0-099e246564a6
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7ac7313c-a31d-4e26-b860-9e3190e3cdd8 tempest-ServerStableDeviceRescueTest-1573183010 tempest-ServerStableDeviceRescueTest-1573183010-project-member] Lock "9e258725-b58a-46c8-a2f0-099e246564a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.841s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:29:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Instance spawned successfully.
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-2f51ed5c-9531-485f-a655-a7f96dfd26f2 req-700ae61b-b962-42fb-871b-58b13f63609c service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received event network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2f51ed5c-9531-485f-a655-a7f96dfd26f2 req-700ae61b-b962-42fb-871b-58b13f63609c service nova] Acquiring lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2f51ed5c-9531-485f-a655-a7f96dfd26f2 req-700ae61b-b962-42fb-871b-58b13f63609c service nova] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2f51ed5c-9531-485f-a655-a7f96dfd26f2 req-700ae61b-b962-42fb-871b-58b13f63609c service nova] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-2f51ed5c-9531-485f-a655-a7f96dfd26f2 req-700ae61b-b962-42fb-871b-58b13f63609c service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] No waiting events found dispatching network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:05 user nova-compute[74892]: WARNING nova.compute.manager [req-2f51ed5c-9531-485f-a655-a7f96dfd26f2 req-700ae61b-b962-42fb-871b-58b13f63609c service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received unexpected event network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae for instance with vm_state building and task_state spawning.
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-2f51ed5c-9531-485f-a655-a7f96dfd26f2 req-700ae61b-b962-42fb-871b-58b13f63609c service nova] [instance: 9e258725-b58a-46c8-a2f0-099e246564a6] Received event network-vif-deleted-ec5b32a8-6aac-40d2-8f9e-a2edc48e49d6 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquired lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.network.neutron [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'info_cache' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:05 user nova-compute[74892]: INFO nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.base [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:29:05 user nova-compute[74892]: INFO nova.compute.manager [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Took 18.62 seconds to build instance.
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1fbee9b6-2d8e-460f-8991-b129504363fd tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.775s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:05 user nova-compute[74892]: INFO nova.compute.manager [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Detaching volume 39da3aca-e6d9-49d9-9d26-ea4225f52869
Nov 15 14:29:05 user nova-compute[74892]: INFO nova.virt.block_device [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Attempting to driver detach volume 39da3aca-e6d9-49d9-9d26-ea4225f52869 from mountpoint /dev/vdb
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Attempting to detach device vdb from instance 532ff00e-4e44-4749-bc09-b5938b073005 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:29:05 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:29:05 user nova-compute[74892]:   <source dev="/dev/sdg"/>
Nov 15 14:29:05 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:29:05 user nova-compute[74892]:   <serial>39da3aca-e6d9-49d9-9d26-ea4225f52869</serial>
Nov 15 14:29:05 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:29:05 user nova-compute[74892]: </disk>
Nov 15 14:29:05 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:29:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Successfully detached device vdb from instance 532ff00e-4e44-4749-bc09-b5938b073005 from the persistent domain config.
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 532ff00e-4e44-4749-bc09-b5938b073005 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:29:05 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:29:05 user nova-compute[74892]:   <source dev="/dev/sdg"/>
Nov 15 14:29:05 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:29:05 user nova-compute[74892]:   <serial>39da3aca-e6d9-49d9-9d26-ea4225f52869</serial>
Nov 15 14:29:05 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:29:05 user nova-compute[74892]: </disk>
Nov 15 14:29:05 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.network.neutron [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating instance_info_cache with network_info: [{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Releasing lock "refresh_cache-45201330-05c4-4109-99c2-d17761f46add" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:29:05 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance destroyed successfully.
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'resources' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.base [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG os_vif [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap904d19af-08, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a52b8987-3e1a-4e2f-b6ff-efdff4ade2c5) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:05 user nova-compute[74892]: INFO os_vif [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08')
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Start _get_guest_xml network_info=[{"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'numa_topology' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.base [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:29:05 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:29:05 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'vcpu_model' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.base [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'pci_devices' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.objects.base [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:29:05 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:29:05 user nova-compute[74892]:   <uuid>45201330-05c4-4109-99c2-d17761f46add</uuid>
Nov 15 14:29:05 user nova-compute[74892]:   <name>instance-00000011</name>
Nov 15 14:29:05 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:29:05 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:29:05 user nova-compute[74892]:   <metadata>
Nov 15 14:29:05 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:29:05 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:29:05 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeTestJSON-server-423975802</nova:name>
Nov 15 14:29:05 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:29:05</nova:creationTime>
Nov 15 14:29:05 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:29:05 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:29:05 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:29:05 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:29:05 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:29:05 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:29:05 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:29:05 user nova-compute[74892]:       <nova:owner>
Nov 15 14:29:05 user nova-compute[74892]:         <nova:user uuid="1a85e0d65c2248e0aca031055b162e86">tempest-AttachVolumeTestJSON-1499270628-project-member</nova:user>
Nov 15 14:29:05 user nova-compute[74892]:         <nova:project uuid="5649287d611341a7850ed74e51b7bfe3">tempest-AttachVolumeTestJSON-1499270628</nova:project>
Nov 15 14:29:05 user nova-compute[74892]:       </nova:owner>
Nov 15 14:29:05 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:29:05 user nova-compute[74892]:       <nova:ports>
Nov 15 14:29:05 user nova-compute[74892]:         <nova:port uuid="904d19af-084f-43ac-8378-cf5b7e822961">
Nov 15 14:29:05 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:29:05 user nova-compute[74892]:         </nova:port>
Nov 15 14:29:05 user nova-compute[74892]:       </nova:ports>
Nov 15 14:29:05 user nova-compute[74892]:     </nova:instance>
Nov 15 14:29:05 user nova-compute[74892]:   </metadata>
Nov 15 14:29:05 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:29:05 user nova-compute[74892]:     <system>
Nov 15 14:29:05 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:29:05 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:29:05 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:29:05 user nova-compute[74892]:       <entry name="serial">45201330-05c4-4109-99c2-d17761f46add</entry>
Nov 15 14:29:05 user nova-compute[74892]:       <entry name="uuid">45201330-05c4-4109-99c2-d17761f46add</entry>
Nov 15 14:29:05 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:29:05 user nova-compute[74892]:     </system>
Nov 15 14:29:05 user nova-compute[74892]:   </sysinfo>
Nov 15 14:29:05 user nova-compute[74892]:   <os>
Nov 15 14:29:05 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:29:05 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:29:05 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:29:05 user nova-compute[74892]:   </os>
Nov 15 14:29:05 user nova-compute[74892]:   <features>
Nov 15 14:29:05 user nova-compute[74892]:     <acpi/>
Nov 15 14:29:05 user nova-compute[74892]:     <apic/>
Nov 15 14:29:05 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:29:05 user nova-compute[74892]:   </features>
Nov 15 14:29:05 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:29:05 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:29:05 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:29:05 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:29:05 user nova-compute[74892]:   </clock>
Nov 15 14:29:05 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:29:05 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:29:05 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:29:05 user nova-compute[74892]:   </cpu>
Nov 15 14:29:05 user nova-compute[74892]:   <devices>
Nov 15 14:29:05 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:29:05 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:29:05 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk"/>
Nov 15 14:29:05 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:29:05 user nova-compute[74892]:     </disk>
Nov 15 14:29:05 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:29:05 user nova-compute[74892]:       <mac address="fa:16:3e:2f:62:55"/>
Nov 15 14:29:05 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:29:05 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:29:05 user nova-compute[74892]:       <target dev="tap904d19af-08"/>
Nov 15 14:29:05 user nova-compute[74892]:     </interface>
Nov 15 14:29:05 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:29:05 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/console.log" append="off"/>
Nov 15 14:29:05 user nova-compute[74892]:     </serial>
Nov 15 14:29:05 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:29:05 user nova-compute[74892]:     <video>
Nov 15 14:29:05 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:29:05 user nova-compute[74892]:     </video>
Nov 15 14:29:05 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:29:05 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:29:05 user nova-compute[74892]:     </rng>
Nov 15 14:29:05 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:29:05 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:29:05 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:29:05 user nova-compute[74892]:     </memballoon>
Nov 15 14:29:05 user nova-compute[74892]:   </devices>
Nov 15 14:29:05 user nova-compute[74892]: </domain>
Nov 15 14:29:05 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 532ff00e-4e44-4749-bc09-b5938b073005 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.objects.instance [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'trusted_certs' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.objects.base [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Cannot resize image /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.objects.instance [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'migration_context' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.objects.base [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Object Instance<45201330-05c4-4109-99c2-d17761f46add> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG os_vif [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15419c0f-5df6-57b2-9991-dab7b4d2f56c', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap904d19af-08, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap904d19af-08, col_values=(('qos', UUID('951abeb5-f53c-4d64-819d-702643cadc38')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap904d19af-08, col_values=(('external_ids', {'iface-id': '904d19af-084f-43ac-8378-cf5b7e822961', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:62:55', 'vm-uuid': '45201330-05c4-4109-99c2-d17761f46add'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:06 user nova-compute[74892]: INFO os_vif [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08')
Nov 15 14:29:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-68817fca-0897-4034-9ba2-222127096109 req-14d60fc0-27ad-45b2-953f-7e6d25fca5c8 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-68817fca-0897-4034-9ba2-222127096109 req-14d60fc0-27ad-45b2-953f-7e6d25fca5c8 service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-68817fca-0897-4034-9ba2-222127096109 req-14d60fc0-27ad-45b2-953f-7e6d25fca5c8 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-68817fca-0897-4034-9ba2-222127096109 req-14d60fc0-27ad-45b2-953f-7e6d25fca5c8 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-68817fca-0897-4034-9ba2-222127096109 req-14d60fc0-27ad-45b2-953f-7e6d25fca5c8 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:08 user nova-compute[74892]: WARNING nova.compute.manager [req-68817fca-0897-4034-9ba2-222127096109 req-14d60fc0-27ad-45b2-953f-7e6d25fca5c8 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state stopped and task_state powering-on.
Nov 15 14:29:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:10 user nova-compute[74892]: DEBUG nova.compute.manager [req-dc5fe469-7fd8-4b38-9100-35be13c5e090 req-0cf29301-e43f-43c4-bb9f-fd20943a23b6 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dc5fe469-7fd8-4b38-9100-35be13c5e090 req-0cf29301-e43f-43c4-bb9f-fd20943a23b6 service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dc5fe469-7fd8-4b38-9100-35be13c5e090 req-0cf29301-e43f-43c4-bb9f-fd20943a23b6 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dc5fe469-7fd8-4b38-9100-35be13c5e090 req-0cf29301-e43f-43c4-bb9f-fd20943a23b6 service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:10 user nova-compute[74892]: DEBUG nova.compute.manager [req-dc5fe469-7fd8-4b38-9100-35be13c5e090 req-0cf29301-e43f-43c4-bb9f-fd20943a23b6 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:10 user nova-compute[74892]: WARNING nova.compute.manager [req-dc5fe469-7fd8-4b38-9100-35be13c5e090 req-0cf29301-e43f-43c4-bb9f-fd20943a23b6 service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state stopped and task_state powering-on.
Nov 15 14:29:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:29:10 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance rebooted successfully.
Nov 15 14:29:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-478f9a9c-cdd8-4bb6-bed5-fe158c8c5776 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:29:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e9693214-e0c7-45c0-9542-3171b45712b4 is timed out.
Nov 15 14:29:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Successfully detached device vdc from instance e9693214-e0c7-45c0-9542-3171b45712b4 from the live domain config.
Nov 15 14:29:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eTcIrptE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:29:12 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[800e023b-4ff9-4410-8483-1d10f676e3eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:29:12 user nova-compute[74892]: No targets found.
Nov 15 14:29:12 user nova-compute[74892]: iSNS:
Nov 15 14:29:12 user nova-compute[74892]: No targets found.
Nov 15 14:29:12 user nova-compute[74892]: STATIC:
Nov 15 14:29:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e
Nov 15 14:29:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:29:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:29:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932
Nov 15 14:29:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:29:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869
Nov 15 14:29:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:12 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4
Nov 15 14:29:12 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:12 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:12 user nova-compute[74892]: FIRMWARE:
Nov 15 14:29:12 user nova-compute[74892]: No targets found.
Nov 15 14:29:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:29:12 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:29:12 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e31e3b2-c1ea-4ed4-92f5-31e72f0eff7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6305e028-994d-4933-a279-bb2cd74ba46f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:29:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:29:12 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:29:12 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00603760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4'): ({'sdf'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Removing single pathed devices sdf {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[867f0d80-9fb8-4a95-b1f1-552a019a7252]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[161bd793-23aa-456b-89c4-c7ee74da0b26]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Flushing IO for device /dev/sdf {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:29:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad85d31-6a29-4faa-8af2-bd04510cbd11]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c825ad-67f8-45bf-8300-e1a85d5c9995]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[447b24b9-603d-4227-9831-57c3c1ec3734]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc78c65-0885-4762-b51f-c3f3827d956a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4, portal: 172.16.0.220,3260]
Nov 15 14:29:13 user nova-compute[74892]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4, portal: 172.16.0.220,3260] successful.
Nov 15 14:29:13 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abc8ed46-2c0c-46b8-9e30-e89c7d4154c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0037a-9a5d-497b-a378-7503bd558ecc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] <== disconnect_volume: return (325ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG nova.objects.instance [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lazy-loading 'flavor' on Instance uuid e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-71d980f1-2e22-4732-9ac9-a006aebee1b7 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.678s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:26 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 532ff00e-4e44-4749-bc09-b5938b073005 is timed out.
Nov 15 14:29:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Successfully detached device vdb from instance 532ff00e-4e44-4749-bc09-b5938b073005 from the live domain config.
Nov 15 14:29:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBnEtCid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:29:26 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9657cce-d2ed-4b8e-9717-643ea9c685b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:29:26 user nova-compute[74892]: No targets found.
Nov 15 14:29:26 user nova-compute[74892]: iSNS:
Nov 15 14:29:26 user nova-compute[74892]: No targets found.
Nov 15 14:29:26 user nova-compute[74892]: STATIC:
Nov 15 14:29:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e
Nov 15 14:29:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:29:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:29:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932
Nov 15 14:29:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:29:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869
Nov 15 14:29:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:26 user nova-compute[74892]: FIRMWARE:
Nov 15 14:29:26 user nova-compute[74892]: No targets found.
Nov 15 14:29:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:29:26 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:29:26 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c0b1fa-683c-41ef-b298-375c3c6a3bd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7820a76-14fc-42bd-af16-d2be746fdce9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:29:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 (non-flash)
Nov 15 14:29:26 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:29:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00416440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869'): ({'sdg'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Removing single pathed devices sdg {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f00e116-fbd9-47fe-8994-e9e30dd9341e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4ff841-3179-4136-90a4-0d99c3296bf9]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Flushing IO for device /dev/sdg {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[59981e89-78db-47a9-b066-591d86245d27]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c4cf2f-daf8-4265-be1d-f86fa3d7cbd8]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] SCSI volumes sdg have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d8703d-388b-436d-b843-255f896ed7f8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[247849f9-5ace-4e9c-ac83-f24084a64f6a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869, portal: 172.16.0.220,3260]
Nov 15 14:29:26 user nova-compute[74892]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869, portal: 172.16.0.220,3260] successful.
Nov 15 14:29:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7976096-bf84-4672-be28-f9721d511532]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] <== disconnect_volume: return (346ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG nova.objects.instance [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'flavor' on Instance uuid 532ff00e-4e44-4749-bc09-b5938b073005 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-09de764e-0c22-4734-9c3f-f5469299eab1 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.672s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:27 user nova-compute[74892]: INFO nova.compute.manager [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Terminating instance
Nov 15 14:29:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-08cac67c-e6bf-4f6d-90fe-3ccb1caff5c6 req-3b1654e7-af8f-4b88-9442-ab91e9ea47b1 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received event network-vif-unplugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-08cac67c-e6bf-4f6d-90fe-3ccb1caff5c6 req-3b1654e7-af8f-4b88-9442-ab91e9ea47b1 service nova] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-08cac67c-e6bf-4f6d-90fe-3ccb1caff5c6 req-3b1654e7-af8f-4b88-9442-ab91e9ea47b1 service nova] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-08cac67c-e6bf-4f6d-90fe-3ccb1caff5c6 req-3b1654e7-af8f-4b88-9442-ab91e9ea47b1 service nova] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-08cac67c-e6bf-4f6d-90fe-3ccb1caff5c6 req-3b1654e7-af8f-4b88-9442-ab91e9ea47b1 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] No waiting events found dispatching network-vif-unplugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-08cac67c-e6bf-4f6d-90fe-3ccb1caff5c6 req-3b1654e7-af8f-4b88-9442-ab91e9ea47b1 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received event network-vif-unplugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:29:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Instance destroyed successfully.
Nov 15 14:29:28 user nova-compute[74892]: DEBUG nova.objects.instance [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lazy-loading 'resources' on Instance uuid 532ff00e-4e44-4749-bc09-b5938b073005 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-505608388',display_name='tempest-VolumesSnapshotTestJSON-instance-505608388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-505608388',id=32,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGlyqyh4WjXXtgmS00Iwxp2IIbVAfdR6Z+rXXwkFLVhzuv/KvC4Vywcl7Iq/s2cgjIIsqUNIQBCGQz2kBqorunVVYTcfbuWZ06U2M1w0EiKtAhXvfl3fgpSuh7pa9mboUw==',key_name='tempest-keypair-1008218788',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f5a1be2c05744b98fb9c6f7176c2da2',ramdisk_id='',reservation_id='r-1mktgl66',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1165101863',owner_user_name='tempest-VolumesSnapshotTestJSON-1165101863-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d6bb6050e1514d048c7bf60d2a45a8e9',uuid=532ff00e-4e44-4749-bc09-b5938b073005,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converting VIF {"id": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "address": "fa:16:3e:6c:60:43", "network": {"id": "f5617195-f836-4420-9223-7552339bf0d7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-451847879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f5a1be2c05744b98fb9c6f7176c2da2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc68ead-01", "ovs_interfaceid": "dfc68ead-0105-4466-ba6e-ca32744c0fe8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:60:43,bridge_name='br-int',has_traffic_filtering=True,id=dfc68ead-0105-4466-ba6e-ca32744c0fe8,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc68ead-01') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_vif [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:60:43,bridge_name='br-int',has_traffic_filtering=True,id=dfc68ead-0105-4466-ba6e-ca32744c0fe8,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc68ead-01') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc68ead-01, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8bf9905-8bc2-4b83-8ff5-5db543cb350c) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:28 user nova-compute[74892]: INFO os_vif [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:60:43,bridge_name='br-int',has_traffic_filtering=True,id=dfc68ead-0105-4466-ba6e-ca32744c0fe8,network=Network(f5617195-f836-4420-9223-7552339bf0d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc68ead-01')
Nov 15 14:29:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBnEtCid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:29:28 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f208eb26-5f0b-4c47-b311-6765b6b5531a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:29:28 user nova-compute[74892]: No targets found.
Nov 15 14:29:28 user nova-compute[74892]: iSNS:
Nov 15 14:29:28 user nova-compute[74892]: No targets found.
Nov 15 14:29:28 user nova-compute[74892]: STATIC:
Nov 15 14:29:28 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e
Nov 15 14:29:28 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:28 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:28 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:29:28 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:28 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:28 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:29:28 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:28 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:28 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932
Nov 15 14:29:28 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:28 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:28 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:29:28 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:29:28 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:29:28 user nova-compute[74892]: FIRMWARE:
Nov 15 14:29:28 user nova-compute[74892]: No targets found.
Nov 15 14:29:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:29:28 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:29:28 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39da3aca-e6d9-49d9-9d26-ea4225f52869', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc65e5d-c952-4a5d-852c-0c7d1f31df73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[403a942b-f22e-4950-919f-ce8b5c044eac]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:28 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:28 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:28 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:28 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:29:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:29:28 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:29:28 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:29:28 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:29:28 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:29:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2015d1b0>, {}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Disconnecting from: [] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] <== disconnect_volume: return (95ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:29:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Deleting instance files /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005_del
Nov 15 14:29:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Deletion of /opt/stack/data/nova/instances/532ff00e-4e44-4749-bc09-b5938b073005_del complete
Nov 15 14:29:28 user nova-compute[74892]: INFO nova.compute.manager [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 15 14:29:28 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:29:28 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:29:29 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Took 0.82 seconds to deallocate network for instance.
Nov 15 14:29:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-105159ec-30bd-49ac-bd61-feba73dc4741 req-415e7da8-b433-4563-a03a-b7d334de3421 service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received event network-vif-deleted-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:29 user nova-compute[74892]: WARNING nova.volume.cinder [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Attachment 0f969860-497f-4dff-bf25-91880e4c0e2a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0f969860-497f-4dff-bf25-91880e4c0e2a. (HTTP 404) (Request-ID: req-cc506c38-d428-47af-9fc3-ce99920d23b6)
Nov 15 14:29:29 user nova-compute[74892]: INFO nova.compute.manager [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 14:29:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b54c370-530e-41fb-aa12-067a53b8b446 req-b7ccc7ae-8344-43c0-bd6a-ea4b65dad98b service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received event network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b54c370-530e-41fb-aa12-067a53b8b446 req-b7ccc7ae-8344-43c0-bd6a-ea4b65dad98b service nova] Acquiring lock "532ff00e-4e44-4749-bc09-b5938b073005-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b54c370-530e-41fb-aa12-067a53b8b446 req-b7ccc7ae-8344-43c0-bd6a-ea4b65dad98b service nova] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7b54c370-530e-41fb-aa12-067a53b8b446 req-b7ccc7ae-8344-43c0-bd6a-ea4b65dad98b service nova] Lock "532ff00e-4e44-4749-bc09-b5938b073005-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-7b54c370-530e-41fb-aa12-067a53b8b446 req-b7ccc7ae-8344-43c0-bd6a-ea4b65dad98b service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] No waiting events found dispatching network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:29 user nova-compute[74892]: WARNING nova.compute.manager [req-7b54c370-530e-41fb-aa12-067a53b8b446 req-b7ccc7ae-8344-43c0-bd6a-ea4b65dad98b service nova] [instance: 532ff00e-4e44-4749-bc09-b5938b073005] Received unexpected event network-vif-plugged-dfc68ead-0105-4466-ba6e-ca32744c0fe8 for instance with vm_state deleted and task_state None.
Nov 15 14:29:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:29 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Deleted allocations for instance 532ff00e-4e44-4749-bc09-b5938b073005
Nov 15 14:29:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-42d77771-9d5b-45a2-9c8a-93dc3bb6a2f7 tempest-VolumesSnapshotTestJSON-1165101863 tempest-VolumesSnapshotTestJSON-1165101863-project-member] Lock "532ff00e-4e44-4749-bc09-b5938b073005" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:42 user nova-compute[74892]: INFO nova.compute.manager [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Detaching volume 7509c7c6-8a33-4549-b8c6-108f5d04b02e
Nov 15 14:29:42 user nova-compute[74892]: INFO nova.virt.block_device [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Attempting to driver detach volume 7509c7c6-8a33-4549-b8c6-108f5d04b02e from mountpoint /dev/vdb
Nov 15 14:29:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Attempting to detach device vdb from instance e9693214-e0c7-45c0-9542-3171b45712b4 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:29:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:29:42 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:29:42 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:29:42 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:29:42 user nova-compute[74892]:   <serial>7509c7c6-8a33-4549-b8c6-108f5d04b02e</serial>
Nov 15 14:29:42 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:29:42 user nova-compute[74892]: </disk>
Nov 15 14:29:42 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:29:42 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Successfully detached device vdb from instance e9693214-e0c7-45c0-9542-3171b45712b4 from the persistent domain config.
Nov 15 14:29:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e9693214-e0c7-45c0-9542-3171b45712b4 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:29:42 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:29:42 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:29:42 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:29:42 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:29:42 user nova-compute[74892]:   <serial>7509c7c6-8a33-4549-b8c6-108f5d04b02e</serial>
Nov 15 14:29:42 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:29:42 user nova-compute[74892]: </disk>
Nov 15 14:29:42 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:29:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:43 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:29:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:29:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:29:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:29:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:29:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7016MB free_disk=24.959110260009766GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e9693214-e0c7-45c0-9542-3171b45712b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 5267e3dc-3c08-4046-836c-6ac540f0476d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 144bf11d-fc91-4bcb-9c63-3e11b3d8661b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1b456afe-f03e-4856-aa42-634959e5547d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance f24a0e1a-d0e9-4db0-81cd-b246970759c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:29:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid a87f39af-29c7-40ee-86c9-ed04a07b9d2e {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:53 user nova-compute[74892]: INFO nova.compute.manager [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Terminating instance
Nov 15 14:29:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:29:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updating instance_info_cache with network_info: [{"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-6480a2c4-92c4-4c98-b57b-08b8b153eba2 req-cfc31d6b-b71a-4ba1-810e-7dd1a07c2c05 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-unplugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6480a2c4-92c4-4c98-b57b-08b8b153eba2 req-cfc31d6b-b71a-4ba1-810e-7dd1a07c2c05 service nova] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6480a2c4-92c4-4c98-b57b-08b8b153eba2 req-cfc31d6b-b71a-4ba1-810e-7dd1a07c2c05 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-6480a2c4-92c4-4c98-b57b-08b8b153eba2 req-cfc31d6b-b71a-4ba1-810e-7dd1a07c2c05 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-6480a2c4-92c4-4c98-b57b-08b8b153eba2 req-cfc31d6b-b71a-4ba1-810e-7dd1a07c2c05 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] No waiting events found dispatching network-vif-unplugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-6480a2c4-92c4-4c98-b57b-08b8b153eba2 req-cfc31d6b-b71a-4ba1-810e-7dd1a07c2c05 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-unplugged-995f76ef-0e34-4c72-8c67-ff575231e6cf for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-a87f39af-29c7-40ee-86c9-ed04a07b9d2e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:29:54 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Instance destroyed successfully.
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.objects.instance [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lazy-loading 'resources' on Instance uuid 5267e3dc-3c08-4046-836c-6ac540f0476d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:24:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1209906851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1209906851',id=25,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYIp96BY4njafdkukW1AZeIh/xphqcEZg1lAcfMjYfkkeNZ2xpYDF6tQzcgcn1LtJYbFmWS2WoB3hKNiC+q/N5fNsJpFr6zwpF74auvR/YJYzlAtbH4nxeEJuGrMhGOJg==',key_name='tempest-keypair-1742187766',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:28:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05fc70face4045788f0a46bd4cc29867',ramdisk_id='',reservation_id='r-ey0qyk5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-769417742',owner_user_name='tempest-AttachVolumeShelveTestJSON-769417742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c3e99992fb747808166fdd03a2420ff',uuid=5267e3dc-3c08-4046-836c-6ac540f0476d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converting VIF {"id": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "address": "fa:16:3e:4a:3a:e4", "network": {"id": "ec0a205a-3a64-46c5-9bc3-4b9abaaee74a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-360152100-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05fc70face4045788f0a46bd4cc29867", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap995f76ef-0e", "ovs_interfaceid": "995f76ef-0e34-4c72-8c67-ff575231e6cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG os_vif [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap995f76ef-0e, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cab76d0c-4ef7-44ef-b877-84705590a3f7) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:54 user nova-compute[74892]: INFO os_vif [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:3a:e4,bridge_name='br-int',has_traffic_filtering=True,id=995f76ef-0e34-4c72-8c67-ff575231e6cf,network=Network(ec0a205a-3a64-46c5-9bc3-4b9abaaee74a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap995f76ef-0e')
Nov 15 14:29:54 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Deleting instance files /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d_del
Nov 15 14:29:54 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Deletion of /opt/stack/data/nova/instances/5267e3dc-3c08-4046-836c-6ac540f0476d_del complete
Nov 15 14:29:54 user nova-compute[74892]: INFO nova.compute.manager [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 14:29:54 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:29:54 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:29:55 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:29:55 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Took 0.77 seconds to deallocate network for instance.
Nov 15 14:29:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-92f0d834-8b75-41bb-bac9-d1839c6c2726 req-76ee6f4d-facf-4edb-a945-fa488bb73e30 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-deleted-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:29:56 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:29:56 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:29:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:56 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Deleted allocations for instance 5267e3dc-3c08-4046-836c-6ac540f0476d
Nov 15 14:29:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5fbeaada-8a85-4d34-bed6-e42e56d00d7e tempest-AttachVolumeShelveTestJSON-769417742 tempest-AttachVolumeShelveTestJSON-769417742-project-member] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-eb0343e3-f2e0-4130-9332-af343a150ce4 req-fa4326d2-5775-472b-bbdd-67f7db507966 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:29:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb0343e3-f2e0-4130-9332-af343a150ce4 req-fa4326d2-5775-472b-bbdd-67f7db507966 service nova] Acquiring lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:29:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb0343e3-f2e0-4130-9332-af343a150ce4 req-fa4326d2-5775-472b-bbdd-67f7db507966 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:29:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eb0343e3-f2e0-4130-9332-af343a150ce4 req-fa4326d2-5775-472b-bbdd-67f7db507966 service nova] Lock "5267e3dc-3c08-4046-836c-6ac540f0476d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:29:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-eb0343e3-f2e0-4130-9332-af343a150ce4 req-fa4326d2-5775-472b-bbdd-67f7db507966 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] No waiting events found dispatching network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:29:56 user nova-compute[74892]: WARNING nova.compute.manager [req-eb0343e3-f2e0-4130-9332-af343a150ce4 req-fa4326d2-5775-472b-bbdd-67f7db507966 service nova] [instance: 5267e3dc-3c08-4046-836c-6ac540f0476d] Received unexpected event network-vif-plugged-995f76ef-0e34-4c72-8c67-ff575231e6cf for instance with vm_state deleted and task_state None.
Nov 15 14:29:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:29:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:03 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e9693214-e0c7-45c0-9542-3171b45712b4 is timed out.
Nov 15 14:30:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Successfully detached device vdb from instance e9693214-e0c7-45c0-9542-3171b45712b4 from the live domain config.
Nov 15 14:30:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ecZWpzvS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:03 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b2df6-9610-45f7-b856-28e5574a7d43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:30:03 user nova-compute[74892]: No targets found.
Nov 15 14:30:03 user nova-compute[74892]: iSNS:
Nov 15 14:30:03 user nova-compute[74892]: No targets found.
Nov 15 14:30:03 user nova-compute[74892]: STATIC:
Nov 15 14:30:03 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e
Nov 15 14:30:03 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:03 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:03 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:30:03 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:03 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:03 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:30:03 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:03 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:03 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932
Nov 15 14:30:03 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:03 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:03 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:30:03 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:03 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:03 user nova-compute[74892]: FIRMWARE:
Nov 15 14:30:03 user nova-compute[74892]: No targets found.
Nov 15 14:30:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:30:03 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:30:03 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ad69c8-75ad-4c34-91c6-98e2b1f0d35c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[095d44de-99b7-44bf-b1fa-3fa7257a2fa4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:03 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:03 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:30:03 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:03 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:03 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:03 user nova-compute[74892]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e (non-flash)
Nov 15 14:30:03 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:03 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2015fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd0b91-d51b-4c29-b805-f35b82d36074]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3f1985-0086-4a7d-97c0-52fe41df7771]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f026e0-a6a1-489d-9beb-5bfe9ba68329]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[035eb7aa-d164-461e-874e-889aefc502a4]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd44b97-9c70-4998-9072-9daf9012d74a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[77205517-3e04-497a-919e-c9140159a477]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e, portal: 172.16.0.220,3260]
Nov 15 14:30:03 user nova-compute[74892]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e, portal: 172.16.0.220,3260] successful.
Nov 15 14:30:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7509c7c6-8a33-4549-b8c6-108f5d04b02e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[512450e5-b675-4605-876a-9582cae83e0c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] <== disconnect_volume: return (339ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:30:04 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lazy-loading 'flavor' on Instance uuid e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ca53c968-22f0-4541-9f29-acf5150bb01c tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.935s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:05 user nova-compute[74892]: INFO nova.compute.manager [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Rescuing
Nov 15 14:30:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:30:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquired lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:30:05 user nova-compute[74892]: DEBUG nova.network.neutron [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG nova.network.neutron [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Updating instance_info_cache with network_info: [{"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Releasing lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-c38ff3d8-bf2e-4118-9a19-212143962287 req-c0bef340-77f6-4cb5-b8cd-94d972f547b8 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c38ff3d8-bf2e-4118-9a19-212143962287 req-c0bef340-77f6-4cb5-b8cd-94d972f547b8 service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c38ff3d8-bf2e-4118-9a19-212143962287 req-c0bef340-77f6-4cb5-b8cd-94d972f547b8 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c38ff3d8-bf2e-4118-9a19-212143962287 req-c0bef340-77f6-4cb5-b8cd-94d972f547b8 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-c38ff3d8-bf2e-4118-9a19-212143962287 req-c0bef340-77f6-4cb5-b8cd-94d972f547b8 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:06 user nova-compute[74892]: WARNING nova.compute.manager [req-c38ff3d8-bf2e-4118-9a19-212143962287 req-c0bef340-77f6-4cb5-b8cd-94d972f547b8 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state active and task_state rescuing.
Nov 15 14:30:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance destroyed successfully.
Nov 15 14:30:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Attempting a stable device rescue
Nov 15 14:30:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74892) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance directory exists: not creating {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 14:30:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Creating image(s)
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "/opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "/opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "/opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG nova.objects.instance [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'trusted_certs' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "6b4be11e5bee6b04d3e5da3e4f7066246a9ba567" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "6b4be11e5bee6b04d3e5da3e4f7066246a9ba567" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG nova.virt.images [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] 0c8b19b3-c0b3-4fa2-ade2-ffa6870ae4fb was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567.part /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-879829ad-d41a-4f5d-9a80-3f5f4cbb3f14 req-01bd056b-c4a7-4052-8ac0-a8a25d3298b4 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-879829ad-d41a-4f5d-9a80-3f5f4cbb3f14 req-01bd056b-c4a7-4052-8ac0-a8a25d3298b4 service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-879829ad-d41a-4f5d-9a80-3f5f4cbb3f14 req-01bd056b-c4a7-4052-8ac0-a8a25d3298b4 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-879829ad-d41a-4f5d-9a80-3f5f4cbb3f14 req-01bd056b-c4a7-4052-8ac0-a8a25d3298b4 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-879829ad-d41a-4f5d-9a80-3f5f4cbb3f14 req-01bd056b-c4a7-4052-8ac0-a8a25d3298b4 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:08 user nova-compute[74892]: WARNING nova.compute.manager [req-879829ad-d41a-4f5d-9a80-3f5f4cbb3f14 req-01bd056b-c4a7-4052-8ac0-a8a25d3298b4 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state active and task_state rescuing.
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567.part /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567.converted" returned: 0 in 0.300s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "6b4be11e5bee6b04d3e5da3e4f7066246a9ba567" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.875s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "6b4be11e5bee6b04d3e5da3e4f7066246a9ba567" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "6b4be11e5bee6b04d3e5da3e4f7066246a9ba567" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567 --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567 --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567,backing_fmt=raw /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567,backing_fmt=raw /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue" returned: 0 in 0.048s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "6b4be11e5bee6b04d3e5da3e4f7066246a9ba567" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'migration_context' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<144bf11d-fc91-4bcb-9c63-3e11b3d8661b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Start _get_guest_xml network_info=[{"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "vif_mac": "fa:16:3e:0e:20:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0c8b19b3-c0b3-4fa2-ade2-ffa6870ae4fb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxXKCWjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '144bf11d-fc91-4bcb-9c63-3e11b3d8661b', 'attached_at': '', 'detached_at': '', 'volume_id': '8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'serial': '8ddb1715-360f-47d9-9c13-ceadfd15e6bc'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'd96b756c-5b42-414a-863b-7fcd0fccd2fb', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'resources' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<144bf11d-fc91-4bcb-9c63-3e11b3d8661b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'numa_topology' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<144bf11d-fc91-4bcb-9c63-3e11b3d8661b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:30:09 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:30:09 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'vcpu_model' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<144bf11d-fc91-4bcb-9c63-3e11b3d8661b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxXKCWjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:09 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:09 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:09 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a534e5-58c4-4725-8f4b-52ba5829e3bc]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QxXKCWjR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 14:30:09 user nova-compute[74892]: node.name = iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:30:09 user nova-compute[74892]: node.tpgt = -1
Nov 15 14:30:09 user nova-compute[74892]: node.startup = automatic
Nov 15 14:30:09 user nova-compute[74892]: node.leading_login = No
Nov 15 14:30:09 user nova-compute[74892]: iface.iscsi_ifacename = default
Nov 15 14:30:09 user nova-compute[74892]: iface.net_ifacename = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.ipaddress = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.prefix_len = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.hwaddress = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.transport_name = tcp
Nov 15 14:30:09 user nova-compute[74892]: iface.initiatorname = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.state = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.vlan_id = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.vlan_priority = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.vlan_state = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.iface_num = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.mtu = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.port = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.bootproto = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.subnet_mask = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.gateway = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.dhcp_alt_client_id = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.dhcp_dns = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.dhcp_learn_iqn = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.dhcp_vendor_id_state = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.dhcp_vendor_id = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.dhcp_slp_da = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.fragmentation = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.gratuitous_arp = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.incoming_forwarding = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.tos_state = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.tos = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.ttl = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.delayed_ack = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.tcp_nagle = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.tcp_wsf_state = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.tcp_wsf = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.tcp_timer_scale = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.tcp_timestamp = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.redirect = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.def_task_mgmt_timeout = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.header_digest = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.data_digest = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.immediate_data = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.initial_r2t = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.data_seq_inorder = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.data_pdu_inorder = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.erl = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.max_receive_data_len = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.first_burst_len = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.max_outstanding_r2t = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.max_burst_len = 0
Nov 15 14:30:09 user nova-compute[74892]: iface.chap_auth = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.bidi_chap = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.strict_login_compliance = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.discovery_auth = <empty>
Nov 15 14:30:09 user nova-compute[74892]: iface.discovery_logout = <empty>
Nov 15 14:30:09 user nova-compute[74892]: node.discovery_address = <empty>
Nov 15 14:30:09 user nova-compute[74892]: node.discovery_port = 0
Nov 15 14:30:09 user nova-compute[74892]: node.discovery_type = static
Nov 15 14:30:09 user nova-compute[74892]: node.session.initial_cmdsn = 0
Nov 15 14:30:09 user nova-compute[74892]: node.session.initial_login_retry_max = 8
Nov 15 14:30:09 user nova-compute[74892]: node.session.xmit_thread_priority = -20
Nov 15 14:30:09 user nova-compute[74892]: node.session.cmds_max = 128
Nov 15 14:30:09 user nova-compute[74892]: node.session.queue_depth = 32
Nov 15 14:30:09 user nova-compute[74892]: node.session.nr_sessions = 1
Nov 15 14:30:09 user nova-compute[74892]: node.session.auth.authmethod = CHAP
Nov 15 14:30:09 user nova-compute[74892]: node.session.auth.username = QxXKCWjR
Nov 15 14:30:09 user nova-compute[74892]: node.session.auth.password = ***
Nov 15 14:30:09 user nova-compute[74892]: node.session.auth.username_in = <empty>
Nov 15 14:30:09 user nova-compute[74892]: node.session.auth.password_in = <empty>
Nov 15 14:30:09 user nova-compute[74892]: node.session.auth.chap_algs = MD5
Nov 15 14:30:09 user nova-compute[74892]: node.session.timeo.replacement_timeout = 120
Nov 15 14:30:09 user nova-compute[74892]: node.session.err_timeo.abort_timeout = 15
Nov 15 14:30:09 user nova-compute[74892]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 14:30:09 user nova-compute[74892]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 14:30:09 user nova-compute[74892]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.FastAbort = Yes
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.InitialR2T = No
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.ImmediateData = Yes
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.MaxConnections = 1
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 14:30:09 user nova-compute[74892]: node.session.iscsi.ERL = 0
Nov 15 14:30:09 user nova-compute[74892]: node.session.scan = manual
Nov 15 14:30:09 user nova-compute[74892]: node.session.reopen_max = 0
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].address = 172.16.0.220
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].port = 3260
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].startup = manual
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].tcp.window_size = 524288
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].tcp.type_of_service = 0
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].timeo.logout_timeout = 15
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].timeo.login_timeout = 15
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].timeo.auth_timeout = 45
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].iscsi.DataDigest = None
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].iscsi.IFMarker = No
Nov 15 14:30:09 user nova-compute[74892]: node.conn[0].iscsi.OFMarker = No
Nov 15 14:30:09 user nova-compute[74892]: # END RECORD
Nov 15 14:30:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3740802-6337-4cf7-b80e-0bc17f12a731]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cb887f-11a8-4b75-aac6-ef030f27b81f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxXKCWjR {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QxXKCWjR" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[64da4697-18cc-4593-a353-515c3dca34c1]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QxXKCWjR'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae92651f-b3f7-4c9a-b35e-800a32ee58dd]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9fe69b-7cb8-46ae-b145-83d3277dd137]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:09 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:09 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:09 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:09 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:09 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:09 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] HCTL ('33', '0', '0', 0) found on session 34 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a415d01-35f2-40c1-84f6-6b66ae0f7ee9]: (4, ('0 0 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Searching for a device in session 34 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxXKCWjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '26537356636613931', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537356636613931', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1598376678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1598376678',id=33,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-pamncegq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:28:34Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=144bf11d-fc91-4bcb-9c63-3e11b3d8661b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "vif_mac": "fa:16:3e:0e:20:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "vif_mac": "fa:16:3e:0e:20:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:20:e4,bridge_name='br-int',has_traffic_filtering=True,id=b3d70342-7983-4724-8efd-b482ab015807,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d70342-79') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'pci_devices' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.objects.base [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Object Instance<144bf11d-fc91-4bcb-9c63-3e11b3d8661b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:30:09 user nova-compute[74892]:   <uuid>144bf11d-fc91-4bcb-9c63-3e11b3d8661b</uuid>
Nov 15 14:30:09 user nova-compute[74892]:   <name>instance-00000021</name>
Nov 15 14:30:09 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:30:09 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:30:09 user nova-compute[74892]:   <metadata>
Nov 15 14:30:09 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:30:09 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:30:09 user nova-compute[74892]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1598376678</nova:name>
Nov 15 14:30:09 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:30:09</nova:creationTime>
Nov 15 14:30:09 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:30:09 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:30:09 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:30:09 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:30:09 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:30:09 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:30:09 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:30:09 user nova-compute[74892]:       <nova:owner>
Nov 15 14:30:09 user nova-compute[74892]:         <nova:user uuid="eccd14bd0c974f4a83aba63fd70df073">tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member</nova:user>
Nov 15 14:30:09 user nova-compute[74892]:         <nova:project uuid="3fcc169292ce42fb9f54aab1db3869bd">tempest-ServerBootFromVolumeStableRescueTest-760148567</nova:project>
Nov 15 14:30:09 user nova-compute[74892]:       </nova:owner>
Nov 15 14:30:09 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:30:09 user nova-compute[74892]:       <nova:ports>
Nov 15 14:30:09 user nova-compute[74892]:         <nova:port uuid="b3d70342-7983-4724-8efd-b482ab015807">
Nov 15 14:30:09 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 14:30:09 user nova-compute[74892]:         </nova:port>
Nov 15 14:30:09 user nova-compute[74892]:       </nova:ports>
Nov 15 14:30:09 user nova-compute[74892]:     </nova:instance>
Nov 15 14:30:09 user nova-compute[74892]:   </metadata>
Nov 15 14:30:09 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:30:09 user nova-compute[74892]:     <system>
Nov 15 14:30:09 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:30:09 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:30:09 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:30:09 user nova-compute[74892]:       <entry name="serial">144bf11d-fc91-4bcb-9c63-3e11b3d8661b</entry>
Nov 15 14:30:09 user nova-compute[74892]:       <entry name="uuid">144bf11d-fc91-4bcb-9c63-3e11b3d8661b</entry>
Nov 15 14:30:09 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:30:09 user nova-compute[74892]:     </system>
Nov 15 14:30:09 user nova-compute[74892]:   </sysinfo>
Nov 15 14:30:09 user nova-compute[74892]:   <os>
Nov 15 14:30:09 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:30:09 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:30:09 user nova-compute[74892]:   </os>
Nov 15 14:30:09 user nova-compute[74892]:   <features>
Nov 15 14:30:09 user nova-compute[74892]:     <acpi/>
Nov 15 14:30:09 user nova-compute[74892]:     <apic/>
Nov 15 14:30:09 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:30:09 user nova-compute[74892]:   </features>
Nov 15 14:30:09 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:30:09 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:30:09 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:30:09 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:30:09 user nova-compute[74892]:   </clock>
Nov 15 14:30:09 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:30:09 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:30:09 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:30:09 user nova-compute[74892]:   </cpu>
Nov 15 14:30:09 user nova-compute[74892]:   <devices>
Nov 15 14:30:09 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:30:09 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:30:09 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:30:09 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:30:09 user nova-compute[74892]:       <serial>8ddb1715-360f-47d9-9c13-ceadfd15e6bc</serial>
Nov 15 14:30:09 user nova-compute[74892]:     </disk>
Nov 15 14:30:09 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:30:09 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:30:09 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue"/>
Nov 15 14:30:09 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:30:09 user nova-compute[74892]:       <boot order="1"/>
Nov 15 14:30:09 user nova-compute[74892]:     </disk>
Nov 15 14:30:09 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:30:09 user nova-compute[74892]:       <mac address="fa:16:3e:0e:20:e4"/>
Nov 15 14:30:09 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:30:09 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:30:09 user nova-compute[74892]:       <target dev="tapb3d70342-79"/>
Nov 15 14:30:09 user nova-compute[74892]:     </interface>
Nov 15 14:30:09 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:30:09 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/console.log" append="off"/>
Nov 15 14:30:09 user nova-compute[74892]:     </serial>
Nov 15 14:30:09 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:30:09 user nova-compute[74892]:     <video>
Nov 15 14:30:09 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:30:09 user nova-compute[74892]:     </video>
Nov 15 14:30:09 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:30:09 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:30:09 user nova-compute[74892]:     </rng>
Nov 15 14:30:09 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:30:09 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:30:09 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:30:09 user nova-compute[74892]:     </memballoon>
Nov 15 14:30:09 user nova-compute[74892]:   </devices>
Nov 15 14:30:09 user nova-compute[74892]: </domain>
Nov 15 14:30:09 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:30:09 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance destroyed successfully.
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] No VIF found with MAC fa:16:3e:0e:20:e4, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:30:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-a81b0fa6-c6c7-4d78-92c1-5f0186e92a29 req-8f0c09c2-c963-443b-a5a7-b8ae27ec2191 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a81b0fa6-c6c7-4d78-92c1-5f0186e92a29 req-8f0c09c2-c963-443b-a5a7-b8ae27ec2191 service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a81b0fa6-c6c7-4d78-92c1-5f0186e92a29 req-8f0c09c2-c963-443b-a5a7-b8ae27ec2191 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a81b0fa6-c6c7-4d78-92c1-5f0186e92a29 req-8f0c09c2-c963-443b-a5a7-b8ae27ec2191 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-a81b0fa6-c6c7-4d78-92c1-5f0186e92a29 req-8f0c09c2-c963-443b-a5a7-b8ae27ec2191 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:11 user nova-compute[74892]: WARNING nova.compute.manager [req-a81b0fa6-c6c7-4d78-92c1-5f0186e92a29 req-8f0c09c2-c963-443b-a5a7-b8ae27ec2191 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state active and task_state rescuing.
Nov 15 14:30:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-84acf7c2-6584-4670-bbcc-db73e308730a tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:13 user nova-compute[74892]: WARNING nova.compute.manager [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state active and task_state rescuing.
Nov 15 14:30:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received event network-changed-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Refreshing instance network info cache due to event network-changed-b7300fe3-c946-4407-859b-953d171638f3. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] Acquiring lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] Acquired lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Refreshing network info cache for port b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Updated VIF entry in instance network info cache for port b7300fe3-c946-4407-859b-953d171638f3. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Updating instance_info_cache with network_info: [{"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-48bdb329-564b-4e9e-9066-d763a91737c8 req-34a8508b-ad44-4718-a2e5-32157e7552f5 service nova] Releasing lock "refresh_cache-7494d800-9096-4cfd-97f7-659fe4f1dcf2" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:30:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:14 user nova-compute[74892]: DEBUG nova.objects.instance [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid 7494d800-9096-4cfd-97f7-659fe4f1dcf2 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:14 user nova-compute[74892]: INFO nova.compute.manager [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Attaching volume e9eac0b0-43ed-40cf-b25e-07989ba18ddc to /dev/vdb
Nov 15 14:30:14 user nova-compute[74892]: DEBUG os_brick.utils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[677e8634-4ef7-4ab2-9e65-7d275c39d3a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[341b946b-1fdf-4474-821c-a9dbdef24b9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4d72a6-aee2-467b-ac5d-a204ef67342c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[05644b24-cff6-4842-a82e-c8015c28b88d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:30:15 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b5ce3-52da-40f8-a8fd-1e6b00d7f9ae]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG os_brick.utils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Updating existing volume attachment record: 90bc6806-d430-4f90-9963-3ec5779a2fe7 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-changed-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Refreshing instance network info cache due to event network-changed-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] Acquiring lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] Acquired lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG nova.network.neutron [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Refreshing network info cache for port c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Stashing vm_state: active {{(pid=74892) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:15 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:30:15 user nova-compute[74892]: INFO nova.compute.claims [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Claim successful on node user
Nov 15 14:30:15 user nova-compute[74892]: INFO nova.compute.resource_tracker [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating resource usage from migration 06a91167-7b7f-4059-86b8-44d923c15529
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.network.neutron [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updated VIF entry in instance network info cache for port c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.network.neutron [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updating instance_info_cache with network_info: [{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] Releasing lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-changed-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Refreshing instance network info cache due to event network-changed-90e29962-319e-43d8-b270-26d1859d0d36. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] Acquiring lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] Acquired lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.network.neutron [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Refreshing network info cache for port 90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.693s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:16 user nova-compute[74892]: INFO nova.compute.manager [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Migrating
Nov 15 14:30:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.network.neutron [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updated VIF entry in instance network info cache for port 90e29962-319e-43d8-b270-26d1859d0d36. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.network.neutron [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating instance_info_cache with network_info: [{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a1c6cca4-a890-4ca7-a7cf-1b620c6602bc req-511101de-6697-46d5-9d63-483045cdfb01 service nova] Releasing lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquired lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:30:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating instance_info_cache with network_info: [{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Releasing lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Starting migrate_disk_and_power_off {{(pid=74892) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-75fef1c0-aab4-4100-abc8-54a83542f920 req-c25cb64a-8126-4b89-a67a-b016fd10aee6 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-unplugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75fef1c0-aab4-4100-abc8-54a83542f920 req-c25cb64a-8126-4b89-a67a-b016fd10aee6 service nova] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75fef1c0-aab4-4100-abc8-54a83542f920 req-c25cb64a-8126-4b89-a67a-b016fd10aee6 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-75fef1c0-aab4-4100-abc8-54a83542f920 req-c25cb64a-8126-4b89-a67a-b016fd10aee6 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-75fef1c0-aab4-4100-abc8-54a83542f920 req-c25cb64a-8126-4b89-a67a-b016fd10aee6 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] No waiting events found dispatching network-vif-unplugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:17 user nova-compute[74892]: WARNING nova.compute.manager [req-75fef1c0-aab4-4100-abc8-54a83542f920 req-c25cb64a-8126-4b89-a67a-b016fd10aee6 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received unexpected event network-vif-unplugged-90e29962-319e-43d8-b270-26d1859d0d36 for instance with vm_state active and task_state resize_migrating.
Nov 15 14:30:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:18 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance destroyed successfully.
Nov 15 14:30:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836258062',display_name='tempest-ServerActionsTestOtherA-server-1836258062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836258062',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-tgmqdx1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:30:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=1b456afe-f03e-4856-aa42-634959e5547d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-643720614-network", "vif_mac": "fa:16:3e:81:3e:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-643720614-network", "vif_mac": "fa:16:3e:81:3e:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_vif [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90e29962-31, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc1e50f7-dc5c-4b6d-9917-8ef5056f44df) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:18 user nova-compute[74892]: INFO os_vif [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31')
Nov 15 14:30:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQyDsgUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:18 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b83ce79-dde1-4710-bc58-7ed710719a7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:30:18 user nova-compute[74892]: No targets found.
Nov 15 14:30:18 user nova-compute[74892]: iSNS:
Nov 15 14:30:18 user nova-compute[74892]: No targets found.
Nov 15 14:30:18 user nova-compute[74892]: STATIC:
Nov 15 14:30:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:30:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:30:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932
Nov 15 14:30:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:30:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:18 user nova-compute[74892]: FIRMWARE:
Nov 15 14:30:18 user nova-compute[74892]: No targets found.
Nov 15 14:30:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:30:18 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:30:18 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e002be-0aad-44ee-b9d6-2c0f70b4413f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92e3edc-7001-4860-a3a0-c1be2b95595e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:18 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:18 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:18 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:18 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:18 user nova-compute[74892]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:18 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd006289d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f'): ({'sde'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Removing single pathed devices sde {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e31031-c1ac-4ffa-853c-ab49008ff2a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4ac866-cbba-4d0c-9750-df51a7aa096f]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flushing IO for device /dev/sde {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ec292a-8750-40fb-86ed-9535ea8968e0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2576566-35d8-437a-88f4-5f26e9fb7c76]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2c748622',) {{(pid=85038) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e650cb14-7c25-461e-a93f-dfb4190cb768]: (4, None) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5138ce55-9b7e-41ea-9e7b-095943ff238b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[586f19e7-5d0c-4b80-a139-aa3bc88915f2]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260]
Nov 15 14:30:18 user nova-compute[74892]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260] successful.
Nov 15 14:30:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6e066-fd17-4675-b878-2ad575216bab]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== disconnect_volume: return (358ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:30:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Port 90e29962-319e-43d8-b270-26d1859d0d36 binding to destination host user is already ACTIVE {{(pid=74892) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-57243cb5-8cf3-4890-9381-8638b1539201 req-62eecdae-e0ef-4a18-ada5-c1b4302b67dd service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-57243cb5-8cf3-4890-9381-8638b1539201 req-62eecdae-e0ef-4a18-ada5-c1b4302b67dd service nova] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-57243cb5-8cf3-4890-9381-8638b1539201 req-62eecdae-e0ef-4a18-ada5-c1b4302b67dd service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-57243cb5-8cf3-4890-9381-8638b1539201 req-62eecdae-e0ef-4a18-ada5-c1b4302b67dd service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-57243cb5-8cf3-4890-9381-8638b1539201 req-62eecdae-e0ef-4a18-ada5-c1b4302b67dd service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] No waiting events found dispatching network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:19 user nova-compute[74892]: WARNING nova.compute.manager [req-57243cb5-8cf3-4890-9381-8638b1539201 req-62eecdae-e0ef-4a18-ada5-c1b4302b67dd service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received unexpected event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 for instance with vm_state active and task_state resize_migrated.
Nov 15 14:30:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquired lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:30:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating instance_info_cache with network_info: [{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Releasing lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG os_brick.utils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f768915-ae24-4163-af4c-735b780932b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd26a2d-904e-4cab-af5a-907b45e3cf6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db726d5-e1be-4b19-bc84-d3c7b09b228e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcc1f45-0b46-4fa8-83e7-94288eca0eb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:30:20 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:30:20 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[26332b52-824a-4bb8-8c73-e809ab862baf]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:30:20 user nova-compute[74892]: DEBUG os_brick.utils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfhFWwpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:23 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:23 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:23 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c0cfec-a787-44ca-8203-5620d52e967f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:30:23 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9391cef-83c3-48de-b482-a6d7a33df99c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc] added
Nov 15 14:30:23 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0097f2-097e-429e-9d8a-d27cc2023cf4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e06bf5e-7d4c-449f-bc91-44d601209b8a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YfhFWwpX {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YfhFWwpX" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceff6e5c-5e2f-43d1-9557-3b3197b2accd]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YfhFWwpX'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ecb79f-ae0b-4364-b151-5c5578141532]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f381980-c6ce-497d-9317-ced5c3624445]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:23 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:23 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd919e1-0092-4974-919f-295e50ca409d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc, portal: 172.16.0.220,3260]
Nov 15 14:30:23 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc, portal: 172.16.0.220,3260] successful.
Nov 15 14:30:23 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d1a299-b3c2-457b-aba1-21c1d879e35d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8ea6d4-92b9-4257-8a41-f0848359c95f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:23 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:23 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:23 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb43073-8ab1-46b0-915f-7415619e18ee]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:30:23 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfhFWwpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:30:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26161613037616261', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161613037616261', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:30:24 user nova-compute[74892]: DEBUG nova.objects.instance [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid 7494d800-9096-4cfd-97f7-659fe4f1dcf2 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:24 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:30:24 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:30:24 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:30:24 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:30:24 user nova-compute[74892]:   <serial>e9eac0b0-43ed-40cf-b25e-07989ba18ddc</serial>
Nov 15 14:30:24 user nova-compute[74892]: </disk>
Nov 15 14:30:24 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:30:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:30:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:30:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No VIF found with MAC fa:16:3e:01:32:68, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:30:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-49a1391b-4ce2-40a3-a286-9d28465809fc tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.551s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:26 user nova-compute[74892]: INFO nova.compute.manager [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Detaching volume e9eac0b0-43ed-40cf-b25e-07989ba18ddc
Nov 15 14:30:26 user nova-compute[74892]: INFO nova.virt.block_device [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Attempting to driver detach volume e9eac0b0-43ed-40cf-b25e-07989ba18ddc from mountpoint /dev/vdb
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Attempting to detach device vdb from instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:30:26 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:30:26 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:30:26 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:30:26 user nova-compute[74892]:   <serial>e9eac0b0-43ed-40cf-b25e-07989ba18ddc</serial>
Nov 15 14:30:26 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:30:26 user nova-compute[74892]: </disk>
Nov 15 14:30:26 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:30:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully detached device vdb from instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 from the persistent domain config.
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:30:26 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:30:26 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:30:26 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:30:26 user nova-compute[74892]:   <serial>e9eac0b0-43ed-40cf-b25e-07989ba18ddc</serial>
Nov 15 14:30:26 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:30:26 user nova-compute[74892]: </disk>
Nov 15 14:30:26 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Starting finish_migration {{(pid=74892) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance directory exists: not creating {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 14:30:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Creating image(s)
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Ensure instance console log exists: /opt/stack/data/nova/instances/1b456afe-f03e-4856-aa42-634959e5547d/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Start _get_guest_xml network_info=[{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-643720614-network", "vif_mac": "fa:16:3e:81:3e:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQyDsgUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1b456afe-f03e-4856-aa42-634959e5547d', 'attached_at': '2023-11-15T14:30:27.000000', 'detached_at': '', 'volume_id': 'f7463944-aa87-4fae-9e85-4ec46ba5038f', 'serial': 'f7463944-aa87-4fae-9e85-4ec46ba5038f'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'ae148469-de74-4699-a556-f8790f02a174', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:30:27 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:30:27 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQyDsgUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:27 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:27 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:27 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fa33f7-8a2b-48c4-8317-78a588246fdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:30:27 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146dac2-84f8-466d-ba9e-08195a1b446e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f] added
Nov 15 14:30:27 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4951fcbf-1bfc-412c-8be2-eb50086c92ea]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6fac4e-4a4b-45d5-9666-5813ff3ffd5c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQyDsgUR {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQyDsgUR" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[55069d11-aaa9-4d5a-b3ab-b67593541cf6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tQyDsgUR'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8bc1db-5b67-48be-af40-09cde5f03923]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[81668bf7-deea-4f77-945b-d042b48d6288]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:27 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:27 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f248f69a-aba9-4fec-a73d-fd615b036b5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260]
Nov 15 14:30:27 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260] successful.
Nov 15 14:30:27 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c83116b-2dc4-49eb-ad8d-f68aeb9f5ccc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8412e801-7865-4c2d-826a-fae211738251]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:27 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:27 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:27 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24f03a3-8d9f-43fa-92a3-ccb26bd57fdf]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:30:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQyDsgUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23865663765326133', 'path': '/dev/sde'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865663765326133', 'path': '/dev/sde'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836258062',display_name='tempest-ServerActionsTestOtherA-server-1836258062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836258062',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-tgmqdx1p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=1b456afe-f03e-4856-aa42-634959e5547d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-643720614-network", "vif_mac": "fa:16:3e:81:3e:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-643720614-network", "vif_mac": "fa:16:3e:81:3e:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:30:28 user nova-compute[74892]:   <uuid>1b456afe-f03e-4856-aa42-634959e5547d</uuid>
Nov 15 14:30:28 user nova-compute[74892]:   <name>instance-00000023</name>
Nov 15 14:30:28 user nova-compute[74892]:   <memory>2097152</memory>
Nov 15 14:30:28 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:30:28 user nova-compute[74892]:   <metadata>
Nov 15 14:30:28 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:30:28 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:30:28 user nova-compute[74892]:       <nova:name>tempest-ServerActionsTestOtherA-server-1836258062</nova:name>
Nov 15 14:30:28 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:30:27</nova:creationTime>
Nov 15 14:30:28 user nova-compute[74892]:       <nova:flavor name="m1.small">
Nov 15 14:30:28 user nova-compute[74892]:         <nova:memory>2048</nova:memory>
Nov 15 14:30:28 user nova-compute[74892]:         <nova:disk>20</nova:disk>
Nov 15 14:30:28 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:30:28 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:30:28 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:30:28 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:30:28 user nova-compute[74892]:       <nova:owner>
Nov 15 14:30:28 user nova-compute[74892]:         <nova:user uuid="abe166e9b6134abf85db0e21ec1e100d">tempest-ServerActionsTestOtherA-2044893964-project-member</nova:user>
Nov 15 14:30:28 user nova-compute[74892]:         <nova:project uuid="bbe544848b48449381967e24f274b7bd">tempest-ServerActionsTestOtherA-2044893964</nova:project>
Nov 15 14:30:28 user nova-compute[74892]:       </nova:owner>
Nov 15 14:30:28 user nova-compute[74892]:       <nova:ports>
Nov 15 14:30:28 user nova-compute[74892]:         <nova:port uuid="90e29962-319e-43d8-b270-26d1859d0d36">
Nov 15 14:30:28 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:30:28 user nova-compute[74892]:         </nova:port>
Nov 15 14:30:28 user nova-compute[74892]:       </nova:ports>
Nov 15 14:30:28 user nova-compute[74892]:     </nova:instance>
Nov 15 14:30:28 user nova-compute[74892]:   </metadata>
Nov 15 14:30:28 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:30:28 user nova-compute[74892]:     <system>
Nov 15 14:30:28 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:30:28 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:30:28 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:30:28 user nova-compute[74892]:       <entry name="serial">1b456afe-f03e-4856-aa42-634959e5547d</entry>
Nov 15 14:30:28 user nova-compute[74892]:       <entry name="uuid">1b456afe-f03e-4856-aa42-634959e5547d</entry>
Nov 15 14:30:28 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:30:28 user nova-compute[74892]:     </system>
Nov 15 14:30:28 user nova-compute[74892]:   </sysinfo>
Nov 15 14:30:28 user nova-compute[74892]:   <os>
Nov 15 14:30:28 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:30:28 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:30:28 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:30:28 user nova-compute[74892]:   </os>
Nov 15 14:30:28 user nova-compute[74892]:   <features>
Nov 15 14:30:28 user nova-compute[74892]:     <acpi/>
Nov 15 14:30:28 user nova-compute[74892]:     <apic/>
Nov 15 14:30:28 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:30:28 user nova-compute[74892]:   </features>
Nov 15 14:30:28 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:30:28 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:30:28 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:30:28 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:30:28 user nova-compute[74892]:   </clock>
Nov 15 14:30:28 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:30:28 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:30:28 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:30:28 user nova-compute[74892]:   </cpu>
Nov 15 14:30:28 user nova-compute[74892]:   <devices>
Nov 15 14:30:28 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:30:28 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:30:28 user nova-compute[74892]:       <source dev="/dev/sde"/>
Nov 15 14:30:28 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:30:28 user nova-compute[74892]:       <serial>f7463944-aa87-4fae-9e85-4ec46ba5038f</serial>
Nov 15 14:30:28 user nova-compute[74892]:     </disk>
Nov 15 14:30:28 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:30:28 user nova-compute[74892]:       <mac address="fa:16:3e:81:3e:de"/>
Nov 15 14:30:28 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:30:28 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:30:28 user nova-compute[74892]:       <target dev="tap90e29962-31"/>
Nov 15 14:30:28 user nova-compute[74892]:     </interface>
Nov 15 14:30:28 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:30:28 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/1b456afe-f03e-4856-aa42-634959e5547d/console.log" append="off"/>
Nov 15 14:30:28 user nova-compute[74892]:     </serial>
Nov 15 14:30:28 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:30:28 user nova-compute[74892]:     <video>
Nov 15 14:30:28 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:30:28 user nova-compute[74892]:     </video>
Nov 15 14:30:28 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:30:28 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:30:28 user nova-compute[74892]:     </rng>
Nov 15 14:30:28 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:30:28 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:30:28 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:30:28 user nova-compute[74892]:     </memballoon>
Nov 15 14:30:28 user nova-compute[74892]:   </devices>
Nov 15 14:30:28 user nova-compute[74892]: </domain>
Nov 15 14:30:28 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836258062',display_name='tempest-ServerActionsTestOtherA-server-1836258062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836258062',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-tgmqdx1p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=1b456afe-f03e-4856-aa42-634959e5547d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-643720614-network", "vif_mac": "fa:16:3e:81:3e:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-643720614-network", "vif_mac": "fa:16:3e:81:3e:de"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG os_vif [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d9f8db1-6dc7-5086-8bb5-4a8b26ca25bf', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90e29962-31, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90e29962-31, col_values=(('qos', UUID('6cdd3f85-6410-41b4-9563-63b4e0ad9cd0')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90e29962-31, col_values=(('external_ids', {'iface-id': '90e29962-319e-43d8-b270-26d1859d0d36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:3e:de', 'vm-uuid': '1b456afe-f03e-4856-aa42-634959e5547d'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:28 user nova-compute[74892]: INFO os_vif [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31')
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:30:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] No VIF found with MAC fa:16:3e:81:3e:de, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-a6badc36-32c5-4e58-a062-dfc963fbe40e req-b0864f17-af2b-49d0-ba8e-4f9e4fc0c2fe service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a6badc36-32c5-4e58-a062-dfc963fbe40e req-b0864f17-af2b-49d0-ba8e-4f9e4fc0c2fe service nova] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a6badc36-32c5-4e58-a062-dfc963fbe40e req-b0864f17-af2b-49d0-ba8e-4f9e4fc0c2fe service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a6badc36-32c5-4e58-a062-dfc963fbe40e req-b0864f17-af2b-49d0-ba8e-4f9e4fc0c2fe service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-a6badc36-32c5-4e58-a062-dfc963fbe40e req-b0864f17-af2b-49d0-ba8e-4f9e4fc0c2fe service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] No waiting events found dispatching network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:30 user nova-compute[74892]: WARNING nova.compute.manager [req-a6badc36-32c5-4e58-a062-dfc963fbe40e req-b0864f17-af2b-49d0-ba8e-4f9e4fc0c2fe service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received unexpected event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 for instance with vm_state active and task_state resize_finish.
Nov 15 14:30:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:32 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:30:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance running successfully.
Nov 15 14:30:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Failed to set time: agent not configured {{(pid=74892) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 14:30:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bb410f9a-da4e-41d6-b4dc-91a5b65463a5 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] finish_migration finished successfully. {{(pid=74892) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 14:30:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-9b240f0a-a601-4bd9-9fcf-d9c1dacaef53 req-072a85aa-b32e-4d24-a097-363677932240 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9b240f0a-a601-4bd9-9fcf-d9c1dacaef53 req-072a85aa-b32e-4d24-a097-363677932240 service nova] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9b240f0a-a601-4bd9-9fcf-d9c1dacaef53 req-072a85aa-b32e-4d24-a097-363677932240 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9b240f0a-a601-4bd9-9fcf-d9c1dacaef53 req-072a85aa-b32e-4d24-a097-363677932240 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-9b240f0a-a601-4bd9-9fcf-d9c1dacaef53 req-072a85aa-b32e-4d24-a097-363677932240 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] No waiting events found dispatching network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:32 user nova-compute[74892]: WARNING nova.compute.manager [req-9b240f0a-a601-4bd9-9fcf-d9c1dacaef53 req-072a85aa-b32e-4d24-a097-363677932240 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received unexpected event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 for instance with vm_state active and task_state resize_finish.
Nov 15 14:30:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:33 user nova-compute[74892]: INFO nova.compute.manager [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Terminating instance
Nov 15 14:30:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-88dd311d-a1dd-490f-80f5-75edc43ba547 req-7d957fad-6287-4af5-aa29-f3bb63f7acbb service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-unplugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-88dd311d-a1dd-490f-80f5-75edc43ba547 req-7d957fad-6287-4af5-aa29-f3bb63f7acbb service nova] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-88dd311d-a1dd-490f-80f5-75edc43ba547 req-7d957fad-6287-4af5-aa29-f3bb63f7acbb service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-88dd311d-a1dd-490f-80f5-75edc43ba547 req-7d957fad-6287-4af5-aa29-f3bb63f7acbb service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-88dd311d-a1dd-490f-80f5-75edc43ba547 req-7d957fad-6287-4af5-aa29-f3bb63f7acbb service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] No waiting events found dispatching network-vif-unplugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-88dd311d-a1dd-490f-80f5-75edc43ba547 req-7d957fad-6287-4af5-aa29-f3bb63f7acbb service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-unplugged-39ff716a-e25e-481c-b0ef-86fdc490898f for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Instance destroyed successfully.
Nov 15 14:30:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lazy-loading 'resources' on Instance uuid e9693214-e0c7-45c0-9542-3171b45712b4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-36177430',display_name='tempest-TestServerVolumeAttachmentScenario-server-36177430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-36177430',id=29,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhjvrPZyXOfninpO/NgNwR7yCvEXPKK+gH+WVw11gIp+fFHuOoYU+y4iozPLH4oCjNtysQOjcpJRPkl60xQl6NejRKAAeWbVvwZpkTxlEr3IXzJ4YQ/K0wsm6Dxx97+lw==',key_name='tempest-keypair-318216603',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:26:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fa953359477469bba26032f601f6043',ramdisk_id='',reservation_id='r-07ycwb6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1848434449',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1848434449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:26:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f222c367503c4534a9c11a6c6fd86953',uuid=e9693214-e0c7-45c0-9542-3171b45712b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:30:33 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Converting VIF {"id": "39ff716a-e25e-481c-b0ef-86fdc490898f", "address": "fa:16:3e:25:c2:26", "network": {"id": "1fafa239-7b18-402d-be8c-f507184de3b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1206900355-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fa953359477469bba26032f601f6043", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39ff716a-e2", "ovs_interfaceid": "39ff716a-e25e-481c-b0ef-86fdc490898f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:c2:26,bridge_name='br-int',has_traffic_filtering=True,id=39ff716a-e25e-481c-b0ef-86fdc490898f,network=Network(1fafa239-7b18-402d-be8c-f507184de3b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39ff716a-e2') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG os_vif [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:c2:26,bridge_name='br-int',has_traffic_filtering=True,id=39ff716a-e25e-481c-b0ef-86fdc490898f,network=Network(1fafa239-7b18-402d-be8c-f507184de3b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39ff716a-e2') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39ff716a-e2, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d909be67-9fd7-477b-abe5-0f0e7a20f556) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:30:34 user nova-compute[74892]: INFO os_vif [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:c2:26,bridge_name='br-int',has_traffic_filtering=True,id=39ff716a-e25e-481c-b0ef-86fdc490898f,network=Network(1fafa239-7b18-402d-be8c-f507184de3b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39ff716a-e2')
Nov 15 14:30:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Deleting instance files /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4_del
Nov 15 14:30:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Deletion of /opt/stack/data/nova/instances/e9693214-e0c7-45c0-9542-3171b45712b4_del complete
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: INFO nova.compute.manager [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 15 14:30:34 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:35 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Took 1.48 seconds to deallocate network for instance.
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] No waiting events found dispatching network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:35 user nova-compute[74892]: WARNING nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received unexpected event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f for instance with vm_state active and task_state deleting.
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] No waiting events found dispatching network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:35 user nova-compute[74892]: WARNING nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received unexpected event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f for instance with vm_state active and task_state deleting.
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] No waiting events found dispatching network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:35 user nova-compute[74892]: WARNING nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received unexpected event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f for instance with vm_state active and task_state deleting.
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-unplugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] No waiting events found dispatching network-vif-unplugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-unplugged-39ff716a-e25e-481c-b0ef-86fdc490898f for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Acquiring lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] Lock "e9693214-e0c7-45c0-9542-3171b45712b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] No waiting events found dispatching network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:35 user nova-compute[74892]: WARNING nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received unexpected event network-vif-plugged-39ff716a-e25e-481c-b0ef-86fdc490898f for instance with vm_state active and task_state deleting.
Nov 15 14:30:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-010d693c-b005-43d3-92aa-1ec4ce61ce4b req-9857875d-387e-4d10-b4fb-7e9e96065a5e service nova] [instance: e9693214-e0c7-45c0-9542-3171b45712b4] Received event network-vif-deleted-39ff716a-e25e-481c-b0ef-86fdc490898f {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:36 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:30:36 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:30:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.706s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:36 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Deleted allocations for instance e9693214-e0c7-45c0-9542-3171b45712b4
Nov 15 14:30:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-dd5857fe-3654-45a8-8e7c-8663c31a93c0 tempest-TestServerVolumeAttachmentScenario-1848434449 tempest-TestServerVolumeAttachmentScenario-1848434449-project-member] Lock "e9693214-e0c7-45c0-9542-3171b45712b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.396s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:37 user nova-compute[74892]: INFO nova.compute.manager [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Terminating instance
Nov 15 14:30:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-1dee0bc2-b584-40de-87b0-26ea13eedae8 req-b879fe7e-5731-45de-a857-8c822347398c service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received event network-vif-unplugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1dee0bc2-b584-40de-87b0-26ea13eedae8 req-b879fe7e-5731-45de-a857-8c822347398c service nova] Acquiring lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1dee0bc2-b584-40de-87b0-26ea13eedae8 req-b879fe7e-5731-45de-a857-8c822347398c service nova] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1dee0bc2-b584-40de-87b0-26ea13eedae8 req-b879fe7e-5731-45de-a857-8c822347398c service nova] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-1dee0bc2-b584-40de-87b0-26ea13eedae8 req-b879fe7e-5731-45de-a857-8c822347398c service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] No waiting events found dispatching network-vif-unplugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-1dee0bc2-b584-40de-87b0-26ea13eedae8 req-b879fe7e-5731-45de-a857-8c822347398c service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received event network-vif-unplugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:38 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Instance destroyed successfully.
Nov 15 14:30:38 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'resources' on Instance uuid f24a0e1a-d0e9-4db0-81cd-b246970759c4 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2100931145',display_name='tempest-TestVolumeBootPattern-server-2100931145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2100931145',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:29:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-qpzezhrn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:29:05Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=f24a0e1a-d0e9-4db0-81cd-b246970759c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "address": "fa:16:3e:3f:5b:d9", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0efd9ad5-e4", "ovs_interfaceid": "0efd9ad5-e4eb-46b0-bc56-4effcf7647ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5b:d9,bridge_name='br-int',has_traffic_filtering=True,id=0efd9ad5-e4eb-46b0-bc56-4effcf7647ae,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efd9ad5-e4') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_vif [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5b:d9,bridge_name='br-int',has_traffic_filtering=True,id=0efd9ad5-e4eb-46b0-bc56-4effcf7647ae,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efd9ad5-e4') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0efd9ad5-e4, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cd94c8e-bd5d-4eb7-93b5-d4856e3ea3d5) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:30:38 user nova-compute[74892]: INFO os_vif [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:5b:d9,bridge_name='br-int',has_traffic_filtering=True,id=0efd9ad5-e4eb-46b0-bc56-4effcf7647ae,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0efd9ad5-e4')
Nov 15 14:30:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOJcRwBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:38 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[034a39ea-8a82-4463-af42-bf063e6b6b1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:30:38 user nova-compute[74892]: No targets found.
Nov 15 14:30:38 user nova-compute[74892]: iSNS:
Nov 15 14:30:38 user nova-compute[74892]: No targets found.
Nov 15 14:30:38 user nova-compute[74892]: STATIC:
Nov 15 14:30:38 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:30:38 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:38 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:38 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:30:38 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:38 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:38 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932
Nov 15 14:30:38 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:38 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:38 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:30:38 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:38 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:38 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc
Nov 15 14:30:38 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:38 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:38 user nova-compute[74892]: FIRMWARE:
Nov 15 14:30:38 user nova-compute[74892]: No targets found.
Nov 15 14:30:38 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:30:38 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:30:38 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[53323b5b-ab5b-4e87-9e9b-d6daed7f8747]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9574ad66-9ae1-4249-9a7a-04c503035937]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:38 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:38 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:38 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:38 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:38 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:38 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:38 user nova-compute[74892]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 (non-flash)
Nov 15 14:30:38 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:38 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:38 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2057c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932'): ({'sdh'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Removing single pathed devices sdh {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e256d931-ccd0-41e2-b578-5e9c39bf90c9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d4c3d-a476-4c67-9a82-4a40959cbc10]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flushing IO for device /dev/sdh {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bbc9e9-da1d-4812-9b1e-6163916e1964]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.055s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8150188d-f17b-4da3-90da-640d3d623624]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] SCSI volumes sdh have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b308c6-3ef0-4c21-b96e-72e5aee32eb1]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --logout" returned: 0 in 0.176s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ec09b8-7a8f-49a6-a5a1-da9adedd2f00]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932, portal: 172.16.0.220,3260]
Nov 15 14:30:38 user nova-compute[74892]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932, portal: 172.16.0.220,3260] successful.
Nov 15 14:30:38 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc04b894-2178-413a-b83d-871a424fc932 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bc1a09-1bf0-41e9-a768-76a020fdbe3d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== disconnect_volume: return (462ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:30:38 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Deleting instance files /opt/stack/data/nova/instances/f24a0e1a-d0e9-4db0-81cd-b246970759c4_del
Nov 15 14:30:38 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Deletion of /opt/stack/data/nova/instances/f24a0e1a-d0e9-4db0-81cd-b246970759c4_del complete
Nov 15 14:30:38 user nova-compute[74892]: INFO nova.compute.manager [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 15 14:30:38 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:30:38 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:30:39 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:39 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Took 0.68 seconds to deallocate network for instance.
Nov 15 14:30:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-40f425c1-7c25-4603-a571-6a636b4f2021 req-4d98e765-fd45-4a0f-98b1-b8fbd1c59423 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received event network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-40f425c1-7c25-4603-a571-6a636b4f2021 req-4d98e765-fd45-4a0f-98b1-b8fbd1c59423 service nova] Acquiring lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-40f425c1-7c25-4603-a571-6a636b4f2021 req-4d98e765-fd45-4a0f-98b1-b8fbd1c59423 service nova] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-40f425c1-7c25-4603-a571-6a636b4f2021 req-4d98e765-fd45-4a0f-98b1-b8fbd1c59423 service nova] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-40f425c1-7c25-4603-a571-6a636b4f2021 req-4d98e765-fd45-4a0f-98b1-b8fbd1c59423 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] No waiting events found dispatching network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:39 user nova-compute[74892]: WARNING nova.compute.manager [req-40f425c1-7c25-4603-a571-6a636b4f2021 req-4d98e765-fd45-4a0f-98b1-b8fbd1c59423 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received unexpected event network-vif-plugged-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae for instance with vm_state active and task_state deleting.
Nov 15 14:30:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-40f425c1-7c25-4603-a571-6a636b4f2021 req-4d98e765-fd45-4a0f-98b1-b8fbd1c59423 service nova] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Received event network-vif-deleted-0efd9ad5-e4eb-46b0-bc56-4effcf7647ae {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:40 user nova-compute[74892]: INFO nova.compute.manager [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Took 0.98 seconds to detach 1 volumes for instance.
Nov 15 14:30:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: f24a0e1a-d0e9-4db0-81cd-b246970759c4] Deleting volume: bc04b894-2178-413a-b83d-871a424fc932 {{(pid=74892) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 14:30:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:41 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:30:41 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:30:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:41 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Deleted allocations for instance f24a0e1a-d0e9-4db0-81cd-b246970759c4
Nov 15 14:30:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0678fc07-0c4c-40f5-a43d-71f77b766a5f tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "f24a0e1a-d0e9-4db0-81cd-b246970759c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.921s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:44 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:30:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:46 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 is timed out.
Nov 15 14:30:46 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully detached device vdb from instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 from the live domain config.
Nov 15 14:30:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfhFWwpX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:30:46 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:30:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a9b3f4-615c-41b6-8eb8-966d4be82650]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:30:46 user nova-compute[74892]: No targets found.
Nov 15 14:30:46 user nova-compute[74892]: iSNS:
Nov 15 14:30:46 user nova-compute[74892]: No targets found.
Nov 15 14:30:46 user nova-compute[74892]: STATIC:
Nov 15 14:30:46 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:30:46 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:46 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:46 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:30:46 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:46 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:46 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:30:46 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:46 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:46 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc
Nov 15 14:30:46 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:30:46 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:30:46 user nova-compute[74892]: FIRMWARE:
Nov 15 14:30:46 user nova-compute[74892]: No targets found.
Nov 15 14:30:46 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:30:47 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:30:47 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a331912-01b9-45ca-aae1-3879485d0b53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1f255b-e4fc-4f23-8c0d-9026d0cdf3d4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:47 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:47 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:47 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:47 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:30:47 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:30:47 user nova-compute[74892]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc (non-flash)
Nov 15 14:30:47 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:30:47 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd0062b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[af92feac-673c-4eff-b294-96340c7b85aa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[225d1a7c-7567-4040-a833-085ac51dd35e]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e009e4e1-6c35-4ad3-a452-04f62bf5107e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c59694-f8fd-4cae-9fe5-da70dac9f8c3]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0499f5-d8ec-4e8a-aa02-fc31e087e033]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b467d-57f5-4cc7-a3b2-88c71b7e78cd]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc, portal: 172.16.0.220,3260]
Nov 15 14:30:47 user nova-compute[74892]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc, portal: 172.16.0.220,3260] successful.
Nov 15 14:30:47 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9eac0b0-43ed-40cf-b25e-07989ba18ddc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4555c966-0386-45d7-b9fd-1fbc0c75ce37]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== disconnect_volume: return (444ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid 7494d800-9096-4cfd-97f7-659fe4f1dcf2 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c1d4d38d-dc17-4d05-b0ab-e8c971a564c4 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.174s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:30:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:30:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:30:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7614MB free_disk=24.904617309570312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Applying migration context for instance 1b456afe-f03e-4856-aa42-634959e5547d as it has an incoming, in-progress migration 06a91167-7b7f-4059-86b8-44d923c15529. Migration status is finished {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 14:30:49 user nova-compute[74892]: INFO nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating resource usage from migration 06a91167-7b7f-4059-86b8-44d923c15529
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 45201330-05c4-4109-99c2-d17761f46add actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 144bf11d-fc91-4bcb-9c63-3e11b3d8661b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Migration 06a91167-7b7f-4059-86b8-44d923c15529 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1b456afe-f03e-4856-aa42-634959e5547d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:30:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:30:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:30:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:30:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:30:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updating instance_info_cache with network_info: [{"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-6c7fcea3-5818-4f0d-a0e8-91bef820d398" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:30:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:30:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:56 user nova-compute[74892]: INFO nova.compute.manager [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Terminating instance
Nov 15 14:30:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-c67cc02b-3aa6-49d5-b864-857e2c12f8dc req-4de0e517-52b2-4ab8-8178-9741a257778a service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c67cc02b-3aa6-49d5-b864-857e2c12f8dc req-4de0e517-52b2-4ab8-8178-9741a257778a service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c67cc02b-3aa6-49d5-b864-857e2c12f8dc req-4de0e517-52b2-4ab8-8178-9741a257778a service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c67cc02b-3aa6-49d5-b864-857e2c12f8dc req-4de0e517-52b2-4ab8-8178-9741a257778a service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-c67cc02b-3aa6-49d5-b864-857e2c12f8dc req-4de0e517-52b2-4ab8-8178-9741a257778a service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-c67cc02b-3aa6-49d5-b864-857e2c12f8dc req-4de0e517-52b2-4ab8-8178-9741a257778a service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-unplugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:30:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Instance destroyed successfully.
Nov 15 14:30:57 user nova-compute[74892]: DEBUG nova.objects.instance [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'resources' on Instance uuid 45201330-05c4-4109-99c2-d17761f46add {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-423975802',display_name='tempest-AttachVolumeTestJSON-server-423975802',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-423975802',id=17,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3sMeTJuuOXwAzJNIErts5Y9oIxNYOYOuDvZtyr5FpUM6D5oDxosMFgneVk2Ge9G8/R7oFPxEtgxszLVSz3D99YlI57msA7glIj9w5S7dmgdhEZX8LZj8Wpb2pcd9ijjg==',key_name='tempest-keypair-1295075987',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-izhbu96w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=45201330-05c4-4109-99c2-d17761f46add,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "904d19af-084f-43ac-8378-cf5b7e822961", "address": "fa:16:3e:2f:62:55", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904d19af-08", "ovs_interfaceid": "904d19af-084f-43ac-8378-cf5b7e822961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG os_vif [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap904d19af-08, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=951abeb5-f53c-4d64-819d-702643cadc38) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:30:57 user nova-compute[74892]: INFO os_vif [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:62:55,bridge_name='br-int',has_traffic_filtering=True,id=904d19af-084f-43ac-8378-cf5b7e822961,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904d19af-08')
Nov 15 14:30:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Deleting instance files /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add_del
Nov 15 14:30:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Deletion of /opt/stack/data/nova/instances/45201330-05c4-4109-99c2-d17761f46add_del complete
Nov 15 14:30:57 user nova-compute[74892]: INFO nova.compute.manager [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 45201330-05c4-4109-99c2-d17761f46add] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 14:30:57 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:30:57 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-2f5c7305-4b05-499f-acbb-99bad8b4e5e8 req-8a537e15-af32-497c-9f44-53cd633fec0e service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-deleted-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:58 user nova-compute[74892]: INFO nova.compute.manager [req-2f5c7305-4b05-499f-acbb-99bad8b4e5e8 req-8a537e15-af32-497c-9f44-53cd633fec0e service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Neutron deleted interface 904d19af-084f-43ac-8378-cf5b7e822961; detaching it from the instance and deleting it from the info cache
Nov 15 14:30:58 user nova-compute[74892]: DEBUG nova.network.neutron [req-2f5c7305-4b05-499f-acbb-99bad8b4e5e8 req-8a537e15-af32-497c-9f44-53cd633fec0e service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:30:58 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 45201330-05c4-4109-99c2-d17761f46add] Took 0.75 seconds to deallocate network for instance.
Nov 15 14:30:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-2f5c7305-4b05-499f-acbb-99bad8b4e5e8 req-8a537e15-af32-497c-9f44-53cd633fec0e service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Detach interface failed, port_id=904d19af-084f-43ac-8378-cf5b7e822961, reason: Instance 45201330-05c4-4109-99c2-d17761f46add could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:58 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Deleted allocations for instance 45201330-05c4-4109-99c2-d17761f46add
Nov 15 14:30:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-98313719-4971-4513-8fc3-c0267703f516 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "45201330-05c4-4109-99c2-d17761f46add" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.138s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-c9d422e8-35cc-4e55-b4c7-4ef2e0973247 req-077ae868-f8a2-4c33-87c6-0d98e8004a8e service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c9d422e8-35cc-4e55-b4c7-4ef2e0973247 req-077ae868-f8a2-4c33-87c6-0d98e8004a8e service nova] Acquiring lock "45201330-05c4-4109-99c2-d17761f46add-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c9d422e8-35cc-4e55-b4c7-4ef2e0973247 req-077ae868-f8a2-4c33-87c6-0d98e8004a8e service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c9d422e8-35cc-4e55-b4c7-4ef2e0973247 req-077ae868-f8a2-4c33-87c6-0d98e8004a8e service nova] Lock "45201330-05c4-4109-99c2-d17761f46add-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:30:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-c9d422e8-35cc-4e55-b4c7-4ef2e0973247 req-077ae868-f8a2-4c33-87c6-0d98e8004a8e service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] No waiting events found dispatching network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:30:58 user nova-compute[74892]: WARNING nova.compute.manager [req-c9d422e8-35cc-4e55-b4c7-4ef2e0973247 req-077ae868-f8a2-4c33-87c6-0d98e8004a8e service nova] [instance: 45201330-05c4-4109-99c2-d17761f46add] Received unexpected event network-vif-plugged-904d19af-084f-43ac-8378-cf5b7e822961 for instance with vm_state deleted and task_state None.
Nov 15 14:31:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:31:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:31:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:31:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:31:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:16 user nova-compute[74892]: INFO nova.compute.manager [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Terminating instance
Nov 15 14:31:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-58e3a645-e26c-4d14-82d3-5da8c6a538c9 req-affbbfcc-03f9-4916-b8e4-da416eedd420 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received event network-vif-unplugged-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-58e3a645-e26c-4d14-82d3-5da8c6a538c9 req-affbbfcc-03f9-4916-b8e4-da416eedd420 service nova] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-58e3a645-e26c-4d14-82d3-5da8c6a538c9 req-affbbfcc-03f9-4916-b8e4-da416eedd420 service nova] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-58e3a645-e26c-4d14-82d3-5da8c6a538c9 req-affbbfcc-03f9-4916-b8e4-da416eedd420 service nova] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-58e3a645-e26c-4d14-82d3-5da8c6a538c9 req-affbbfcc-03f9-4916-b8e4-da416eedd420 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] No waiting events found dispatching network-vif-unplugged-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-58e3a645-e26c-4d14-82d3-5da8c6a538c9 req-affbbfcc-03f9-4916-b8e4-da416eedd420 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received event network-vif-unplugged-b7300fe3-c946-4407-859b-953d171638f3 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Instance destroyed successfully.
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'resources' on Instance uuid 7494d800-9096-4cfd-97f7-659fe4f1dcf2 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-529045353',display_name='tempest-AttachVolumeNegativeTest-server-529045353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-529045353',id=34,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtHhROUYhr4rgN0fZ7k4eL+MKbi8+NzrlxOXXDvsG4G8drEpkyzl3MC/UKsLX+lossQrhj4VZtKYRTEywCjf8A9iY80WgI/EU9c1q/S71HD00sLzBTDtwmaGc0kNi6LHA==',key_name='tempest-keypair-2139922210',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:28:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-8fgsplaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:28:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=7494d800-9096-4cfd-97f7-659fe4f1dcf2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "b7300fe3-c946-4407-859b-953d171638f3", "address": "fa:16:3e:01:32:68", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7300fe3-c9", "ovs_interfaceid": "b7300fe3-c946-4407-859b-953d171638f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:32:68,bridge_name='br-int',has_traffic_filtering=True,id=b7300fe3-c946-4407-859b-953d171638f3,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7300fe3-c9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG os_vif [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:32:68,bridge_name='br-int',has_traffic_filtering=True,id=b7300fe3-c946-4407-859b-953d171638f3,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7300fe3-c9') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7300fe3-c9, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee18ab6f-191e-4496-9609-99cfe9866ac5) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:17 user nova-compute[74892]: INFO os_vif [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:32:68,bridge_name='br-int',has_traffic_filtering=True,id=b7300fe3-c946-4407-859b-953d171638f3,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7300fe3-c9')
Nov 15 14:31:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Deleting instance files /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2_del
Nov 15 14:31:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Deletion of /opt/stack/data/nova/instances/7494d800-9096-4cfd-97f7-659fe4f1dcf2_del complete
Nov 15 14:31:17 user nova-compute[74892]: INFO nova.compute.manager [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 15 14:31:17 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:31:17 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:31:18 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:18 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Took 0.86 seconds to deallocate network for instance.
Nov 15 14:31:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-a7ac6629-3428-417b-a4f5-e5a0cdf00d36 req-bbf71947-7758-49b7-bd7b-ddadcd5000dc service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received event network-vif-deleted-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:18 user nova-compute[74892]: INFO nova.compute.manager [req-a7ac6629-3428-417b-a4f5-e5a0cdf00d36 req-bbf71947-7758-49b7-bd7b-ddadcd5000dc service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Neutron deleted interface b7300fe3-c946-4407-859b-953d171638f3; detaching it from the instance and deleting it from the info cache
Nov 15 14:31:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-a7ac6629-3428-417b-a4f5-e5a0cdf00d36 req-bbf71947-7758-49b7-bd7b-ddadcd5000dc service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-a7ac6629-3428-417b-a4f5-e5a0cdf00d36 req-bbf71947-7758-49b7-bd7b-ddadcd5000dc service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Detach interface failed, port_id=b7300fe3-c946-4407-859b-953d171638f3, reason: Instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:31:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:19 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:31:19 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:31:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-54886603-1482-483f-88b9-cf73c7c808bf req-086d9af1-debb-486d-8b9f-368fc5375ab7 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received event network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-54886603-1482-483f-88b9-cf73c7c808bf req-086d9af1-debb-486d-8b9f-368fc5375ab7 service nova] Acquiring lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-54886603-1482-483f-88b9-cf73c7c808bf req-086d9af1-debb-486d-8b9f-368fc5375ab7 service nova] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-54886603-1482-483f-88b9-cf73c7c808bf req-086d9af1-debb-486d-8b9f-368fc5375ab7 service nova] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-54886603-1482-483f-88b9-cf73c7c808bf req-086d9af1-debb-486d-8b9f-368fc5375ab7 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] No waiting events found dispatching network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:19 user nova-compute[74892]: WARNING nova.compute.manager [req-54886603-1482-483f-88b9-cf73c7c808bf req-086d9af1-debb-486d-8b9f-368fc5375ab7 service nova] [instance: 7494d800-9096-4cfd-97f7-659fe4f1dcf2] Received unexpected event network-vif-plugged-b7300fe3-c946-4407-859b-953d171638f3 for instance with vm_state deleted and task_state None.
Nov 15 14:31:19 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Deleted allocations for instance 7494d800-9096-4cfd-97f7-659fe4f1dcf2
Nov 15 14:31:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3c9cfaa-d193-432b-9907-f4b280f925c2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "7494d800-9096-4cfd-97f7-659fe4f1dcf2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.697s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:24 user nova-compute[74892]: INFO nova.compute.manager [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Rescuing
Nov 15 14:31:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:31:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquired lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:31:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updating instance_info_cache with network_info: [{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Releasing lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-962e4c20-071d-47be-bef1-bec58cf47402 req-58ba37f2-e247-42fe-bf8c-969c9a52e4a8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-962e4c20-071d-47be-bef1-bec58cf47402 req-58ba37f2-e247-42fe-bf8c-969c9a52e4a8 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-962e4c20-071d-47be-bef1-bec58cf47402 req-58ba37f2-e247-42fe-bf8c-969c9a52e4a8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-962e4c20-071d-47be-bef1-bec58cf47402 req-58ba37f2-e247-42fe-bf8c-969c9a52e4a8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-962e4c20-071d-47be-bef1-bec58cf47402 req-58ba37f2-e247-42fe-bf8c-969c9a52e4a8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:25 user nova-compute[74892]: WARNING nova.compute.manager [req-962e4c20-071d-47be-bef1-bec58cf47402 req-58ba37f2-e247-42fe-bf8c-969c9a52e4a8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state active and task_state rescuing.
Nov 15 14:31:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:25 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance destroyed successfully.
Nov 15 14:31:25 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Attempting rescue
Nov 15 14:31:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74892) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance directory exists: not creating {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 14:31:25 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Creating image(s)
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'trusted_certs' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:25 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue" returned: 0 in 0.051s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'migration_context' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.base [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<95ff8c73-db6f-4f15-a42f-83133b4fd7b1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Start _get_guest_xml network_info=[{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:00:5f:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'resources' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.base [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<95ff8c73-db6f-4f15-a42f-83133b4fd7b1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'numa_topology' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.base [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<95ff8c73-db6f-4f15-a42f-83133b4fd7b1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:31:26 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:31:26 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.base [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<95ff8c73-db6f-4f15-a42f-83133b4fd7b1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-768833210',display_name='tempest-ServerRescueNegativeTestJSON-server-768833210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-768833210',id=30,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:26:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-yapgak5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:26:48Z,user_data=None,user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=95ff8c73-db6f-4f15-a42f-83133b4fd7b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:00:5f:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:00:5f:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:5f:0d,bridge_name='br-int',has_traffic_filtering=True,id=80c5a034-82fc-4eb0-8c8e-c5237b599138,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c5a034-82') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'pci_devices' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.objects.base [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<95ff8c73-db6f-4f15-a42f-83133b4fd7b1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:31:26 user nova-compute[74892]:   <uuid>95ff8c73-db6f-4f15-a42f-83133b4fd7b1</uuid>
Nov 15 14:31:26 user nova-compute[74892]:   <name>instance-0000001e</name>
Nov 15 14:31:26 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:31:26 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:31:26 user nova-compute[74892]:   <metadata>
Nov 15 14:31:26 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:31:26 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:31:26 user nova-compute[74892]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-768833210</nova:name>
Nov 15 14:31:26 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:31:26</nova:creationTime>
Nov 15 14:31:26 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:31:26 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:31:26 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:31:26 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:31:26 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:31:26 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:31:26 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:31:26 user nova-compute[74892]:       <nova:owner>
Nov 15 14:31:26 user nova-compute[74892]:         <nova:user uuid="29fa0ea399dc4bafb5d2926ae76261c3">tempest-ServerRescueNegativeTestJSON-454831858-project-member</nova:user>
Nov 15 14:31:26 user nova-compute[74892]:         <nova:project uuid="16fe2666f7194df390f9764790c3663d">tempest-ServerRescueNegativeTestJSON-454831858</nova:project>
Nov 15 14:31:26 user nova-compute[74892]:       </nova:owner>
Nov 15 14:31:26 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:31:26 user nova-compute[74892]:       <nova:ports>
Nov 15 14:31:26 user nova-compute[74892]:         <nova:port uuid="80c5a034-82fc-4eb0-8c8e-c5237b599138">
Nov 15 14:31:26 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:31:26 user nova-compute[74892]:         </nova:port>
Nov 15 14:31:26 user nova-compute[74892]:       </nova:ports>
Nov 15 14:31:26 user nova-compute[74892]:     </nova:instance>
Nov 15 14:31:26 user nova-compute[74892]:   </metadata>
Nov 15 14:31:26 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:31:26 user nova-compute[74892]:     <system>
Nov 15 14:31:26 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:31:26 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:31:26 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:31:26 user nova-compute[74892]:       <entry name="serial">95ff8c73-db6f-4f15-a42f-83133b4fd7b1</entry>
Nov 15 14:31:26 user nova-compute[74892]:       <entry name="uuid">95ff8c73-db6f-4f15-a42f-83133b4fd7b1</entry>
Nov 15 14:31:26 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:31:26 user nova-compute[74892]:     </system>
Nov 15 14:31:26 user nova-compute[74892]:   </sysinfo>
Nov 15 14:31:26 user nova-compute[74892]:   <os>
Nov 15 14:31:26 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:31:26 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:31:26 user nova-compute[74892]:   </os>
Nov 15 14:31:26 user nova-compute[74892]:   <features>
Nov 15 14:31:26 user nova-compute[74892]:     <acpi/>
Nov 15 14:31:26 user nova-compute[74892]:     <apic/>
Nov 15 14:31:26 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:31:26 user nova-compute[74892]:   </features>
Nov 15 14:31:26 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:31:26 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:31:26 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:31:26 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:31:26 user nova-compute[74892]:   </clock>
Nov 15 14:31:26 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:31:26 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:31:26 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:31:26 user nova-compute[74892]:   </cpu>
Nov 15 14:31:26 user nova-compute[74892]:   <devices>
Nov 15 14:31:26 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:31:26 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:31:26 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue"/>
Nov 15 14:31:26 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:31:26 user nova-compute[74892]:     </disk>
Nov 15 14:31:26 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:31:26 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:31:26 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk"/>
Nov 15 14:31:26 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:31:26 user nova-compute[74892]:     </disk>
Nov 15 14:31:26 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:31:26 user nova-compute[74892]:       <mac address="fa:16:3e:00:5f:0d"/>
Nov 15 14:31:26 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:31:26 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:31:26 user nova-compute[74892]:       <target dev="tap80c5a034-82"/>
Nov 15 14:31:26 user nova-compute[74892]:     </interface>
Nov 15 14:31:26 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:31:26 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/console.log" append="off"/>
Nov 15 14:31:26 user nova-compute[74892]:     </serial>
Nov 15 14:31:26 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:31:26 user nova-compute[74892]:     <video>
Nov 15 14:31:26 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:31:26 user nova-compute[74892]:     </video>
Nov 15 14:31:26 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:31:26 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:31:26 user nova-compute[74892]:     </rng>
Nov 15 14:31:26 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:31:26 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:31:26 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:31:26 user nova-compute[74892]:     </memballoon>
Nov 15 14:31:26 user nova-compute[74892]:   </devices>
Nov 15 14:31:26 user nova-compute[74892]: </domain>
Nov 15 14:31:26 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:31:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance destroyed successfully.
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:31:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No VIF found with MAC fa:16:3e:00:5f:0d, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-fb71dce6-c7b4-4394-a1a2-3fc570fe14d5 req-175e0f07-6618-402f-afc0-bd219237b2ba service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fb71dce6-c7b4-4394-a1a2-3fc570fe14d5 req-175e0f07-6618-402f-afc0-bd219237b2ba service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fb71dce6-c7b4-4394-a1a2-3fc570fe14d5 req-175e0f07-6618-402f-afc0-bd219237b2ba service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fb71dce6-c7b4-4394-a1a2-3fc570fe14d5 req-175e0f07-6618-402f-afc0-bd219237b2ba service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-fb71dce6-c7b4-4394-a1a2-3fc570fe14d5 req-175e0f07-6618-402f-afc0-bd219237b2ba service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:27 user nova-compute[74892]: WARNING nova.compute.manager [req-fb71dce6-c7b4-4394-a1a2-3fc570fe14d5 req-175e0f07-6618-402f-afc0-bd219237b2ba service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state active and task_state rescuing.
Nov 15 14:31:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:29 user nova-compute[74892]: WARNING nova.compute.manager [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state active and task_state rescuing.
Nov 15 14:31:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:29 user nova-compute[74892]: WARNING nova.compute.manager [req-2d83266e-a7f2-4883-90a6-5a878261c271 req-157e8263-7b30-4b72-be52-5191e8565b42 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state active and task_state rescuing.
Nov 15 14:31:30 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a1e09261-f7d6-4665-83d9-98261bc394ab tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:31:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "728aaeb0-c063-49da-8046-575c82f5fe4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:31:39 user nova-compute[74892]: INFO nova.compute.claims [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Claim successful on node user
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:31:39 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:31:39 user nova-compute[74892]: INFO nova.virt.block_device [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Booting with volume 4d83ab77-4b12-4570-91b2-f1f82ef37a74 at /dev/vda
Nov 15 14:31:39 user nova-compute[74892]: DEBUG nova.policy [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c73da782783d41dbb370c3df04dec208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdd6323d06f4337995cbb796778b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG os_brick.utils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0685248e-5e7b-4cc6-ba4c-7ff3c5763475]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7ab9b7-94ae-459b-aa74-12d50959498a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6429db49-acb1-4314-810a-8bfeed61a071]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bcf900-d50c-47af-92fc-a5723deac5cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:39 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:31:40 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:31:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e42d8a5-43bf-47dd-8254-414c5d84e63c]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG os_brick.utils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Updating existing volume attachment record: d108aa17-bc2e-441b-a80c-21e7fc24145f {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:31:40 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Successfully created port: 2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Successfully updated port: 2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquired lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-5a7ae549-a032-4bfe-b48c-94e80fd7c867 req-e9863843-f8ee-4b4a-9c93-d1dd4b723300 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received event network-changed-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-5a7ae549-a032-4bfe-b48c-94e80fd7c867 req-e9863843-f8ee-4b4a-9c93-d1dd4b723300 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Refreshing instance network info cache due to event network-changed-2971fb38-d954-4b27-8994-099dededaa9e. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5a7ae549-a032-4bfe-b48c-94e80fd7c867 req-e9863843-f8ee-4b4a-9c93-d1dd4b723300 service nova] Acquiring lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Updating instance_info_cache with network_info: [{"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Releasing lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Instance network_info: |[{"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5a7ae549-a032-4bfe-b48c-94e80fd7c867 req-e9863843-f8ee-4b4a-9c93-d1dd4b723300 service nova] Acquired lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:31:41 user nova-compute[74892]: DEBUG nova.network.neutron [req-5a7ae549-a032-4bfe-b48c-94e80fd7c867 req-e9863843-f8ee-4b4a-9c93-d1dd4b723300 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Refreshing network info cache for port 2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-5a7ae549-a032-4bfe-b48c-94e80fd7c867 req-e9863843-f8ee-4b4a-9c93-d1dd4b723300 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Updated VIF entry in instance network info cache for port 2971fb38-d954-4b27-8994-099dededaa9e. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG nova.network.neutron [req-5a7ae549-a032-4bfe-b48c-94e80fd7c867 req-e9863843-f8ee-4b4a-9c93-d1dd4b723300 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Updating instance_info_cache with network_info: [{"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5a7ae549-a032-4bfe-b48c-94e80fd7c867 req-e9863843-f8ee-4b4a-9c93-d1dd4b723300 service nova] Releasing lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:31:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:31:44 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Creating image(s)
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Ensure instance console log exists: /opt/stack/data/nova/instances/728aaeb0-c063-49da-8046-575c82f5fe4b/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Start _get_guest_xml network_info=[{"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vClioSfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '728aaeb0-c063-49da-8046-575c82f5fe4b', 'attached_at': '', 'detached_at': '', 'volume_id': '4d83ab77-4b12-4570-91b2-f1f82ef37a74', 'serial': '4d83ab77-4b12-4570-91b2-f1f82ef37a74'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'd108aa17-bc2e-441b-a80c-21e7fc24145f', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:31:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:31:44 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vClioSfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:31:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:31:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:31:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:31:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:31:44 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f60f873-152a-4862-94b2-565b33ecd696]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:31:44 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e4555a-6418-41fa-b762-41132cbb5c38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74] added
Nov 15 14:31:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[304825d8-d270-40d8-801a-1b667dce8ed7]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:31:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1445879-8b15-4bef-8fbf-e9c0229d19dc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vClioSfI {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vClioSfI" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[63862883-7d82-422c-a76d-dfb4fd366ca2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vClioSfI'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0ae066-eb40-4837-a587-b8db1acdea49]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e783a182-9801-4b5d-9e9a-fcf9768f3e3b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:31:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:31:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[274d7719-3a69-4978-936d-7d7b7f3f8199]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74, portal: 172.16.0.220,3260]
Nov 15 14:31:45 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74, portal: 172.16.0.220,3260] successful.
Nov 15 14:31:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca862e34-e5de-4bc6-9d62-8a8ee29e2fa8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[072ce7a1-cc04-4892-ae06-8fb47224edb2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:31:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:31:45 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:31:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[840f321b-9954-41bb-bba9-bc61c1376282]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:31:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vClioSfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26436653137303433', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436653137303433', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1447620440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1447620440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1447620440',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj/nmBSVNbz4DZs9U6QYxzfIkWx26+CsbQEVv7+wKWuA6n9YM43dbxTtCbEWGJwT77OIsqdp8KyDSq3M9++yp9E7FTHkf++r+QBx4bFeuyU3UB0DmZZJYKlAFwzrk+b9Q==',key_name='tempest-keypair-1870042644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-ku3ynhf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c73da782783d41dbb370c3df04dec208',uuid=728aaeb0-c063-49da-8046-575c82f5fe4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b0:fa,bridge_name='br-int',has_traffic_filtering=True,id=2971fb38-d954-4b27-8994-099dededaa9e,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2971fb38-d9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.objects.instance [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'pci_devices' on Instance uuid 728aaeb0-c063-49da-8046-575c82f5fe4b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:31:46 user nova-compute[74892]:   <uuid>728aaeb0-c063-49da-8046-575c82f5fe4b</uuid>
Nov 15 14:31:46 user nova-compute[74892]:   <name>instance-00000025</name>
Nov 15 14:31:46 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:31:46 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:31:46 user nova-compute[74892]:   <metadata>
Nov 15 14:31:46 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:31:46 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:31:46 user nova-compute[74892]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1447620440</nova:name>
Nov 15 14:31:46 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:31:44</nova:creationTime>
Nov 15 14:31:46 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:31:46 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:31:46 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:31:46 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:31:46 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:31:46 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:31:46 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:31:46 user nova-compute[74892]:       <nova:owner>
Nov 15 14:31:46 user nova-compute[74892]:         <nova:user uuid="c73da782783d41dbb370c3df04dec208">tempest-TestVolumeBootPattern-1799633332-project-member</nova:user>
Nov 15 14:31:46 user nova-compute[74892]:         <nova:project uuid="1cdd6323d06f4337995cbb796778b449">tempest-TestVolumeBootPattern-1799633332</nova:project>
Nov 15 14:31:46 user nova-compute[74892]:       </nova:owner>
Nov 15 14:31:46 user nova-compute[74892]:       <nova:ports>
Nov 15 14:31:46 user nova-compute[74892]:         <nova:port uuid="2971fb38-d954-4b27-8994-099dededaa9e">
Nov 15 14:31:46 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 14:31:46 user nova-compute[74892]:         </nova:port>
Nov 15 14:31:46 user nova-compute[74892]:       </nova:ports>
Nov 15 14:31:46 user nova-compute[74892]:     </nova:instance>
Nov 15 14:31:46 user nova-compute[74892]:   </metadata>
Nov 15 14:31:46 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:31:46 user nova-compute[74892]:     <system>
Nov 15 14:31:46 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:31:46 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:31:46 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:31:46 user nova-compute[74892]:       <entry name="serial">728aaeb0-c063-49da-8046-575c82f5fe4b</entry>
Nov 15 14:31:46 user nova-compute[74892]:       <entry name="uuid">728aaeb0-c063-49da-8046-575c82f5fe4b</entry>
Nov 15 14:31:46 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:31:46 user nova-compute[74892]:     </system>
Nov 15 14:31:46 user nova-compute[74892]:   </sysinfo>
Nov 15 14:31:46 user nova-compute[74892]:   <os>
Nov 15 14:31:46 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:31:46 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:31:46 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:31:46 user nova-compute[74892]:   </os>
Nov 15 14:31:46 user nova-compute[74892]:   <features>
Nov 15 14:31:46 user nova-compute[74892]:     <acpi/>
Nov 15 14:31:46 user nova-compute[74892]:     <apic/>
Nov 15 14:31:46 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:31:46 user nova-compute[74892]:   </features>
Nov 15 14:31:46 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:31:46 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:31:46 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:31:46 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:31:46 user nova-compute[74892]:   </clock>
Nov 15 14:31:46 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:31:46 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:31:46 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:31:46 user nova-compute[74892]:   </cpu>
Nov 15 14:31:46 user nova-compute[74892]:   <devices>
Nov 15 14:31:46 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:31:46 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:31:46 user nova-compute[74892]:       <source dev="/dev/sdc"/>
Nov 15 14:31:46 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:31:46 user nova-compute[74892]:       <serial>4d83ab77-4b12-4570-91b2-f1f82ef37a74</serial>
Nov 15 14:31:46 user nova-compute[74892]:     </disk>
Nov 15 14:31:46 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:31:46 user nova-compute[74892]:       <mac address="fa:16:3e:d5:b0:fa"/>
Nov 15 14:31:46 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:31:46 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:31:46 user nova-compute[74892]:       <target dev="tap2971fb38-d9"/>
Nov 15 14:31:46 user nova-compute[74892]:     </interface>
Nov 15 14:31:46 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:31:46 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/728aaeb0-c063-49da-8046-575c82f5fe4b/console.log" append="off"/>
Nov 15 14:31:46 user nova-compute[74892]:     </serial>
Nov 15 14:31:46 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:31:46 user nova-compute[74892]:     <video>
Nov 15 14:31:46 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:31:46 user nova-compute[74892]:     </video>
Nov 15 14:31:46 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:31:46 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:31:46 user nova-compute[74892]:     </rng>
Nov 15 14:31:46 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:31:46 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:31:46 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:31:46 user nova-compute[74892]:     </memballoon>
Nov 15 14:31:46 user nova-compute[74892]:   </devices>
Nov 15 14:31:46 user nova-compute[74892]: </domain>
Nov 15 14:31:46 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1447620440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1447620440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1447620440',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj/nmBSVNbz4DZs9U6QYxzfIkWx26+CsbQEVv7+wKWuA6n9YM43dbxTtCbEWGJwT77OIsqdp8KyDSq3M9++yp9E7FTHkf++r+QBx4bFeuyU3UB0DmZZJYKlAFwzrk+b9Q==',key_name='tempest-keypair-1870042644',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-ku3ynhf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:31:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c73da782783d41dbb370c3df04dec208',uuid=728aaeb0-c063-49da-8046-575c82f5fe4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b0:fa,bridge_name='br-int',has_traffic_filtering=True,id=2971fb38-d954-4b27-8994-099dededaa9e,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2971fb38-d9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG os_vif [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b0:fa,bridge_name='br-int',has_traffic_filtering=True,id=2971fb38-d954-4b27-8994-099dededaa9e,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2971fb38-d9') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '820a7ce5-8cca-5067-b09d-e63c5be4f686', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2971fb38-d9, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2971fb38-d9, col_values=(('qos', UUID('5322ef8d-1837-4e56-9c2c-636d662a2108')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2971fb38-d9, col_values=(('external_ids', {'iface-id': '2971fb38-d954-4b27-8994-099dededaa9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:b0:fa', 'vm-uuid': '728aaeb0-c063-49da-8046-575c82f5fe4b'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:46 user nova-compute[74892]: INFO os_vif [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:b0:fa,bridge_name='br-int',has_traffic_filtering=True,id=2971fb38-d954-4b27-8994-099dededaa9e,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2971fb38-d9')
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No VIF found with MAC fa:16:3e:d5:b0:fa, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:31:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-2ccf2278-ff60-4c3b-bf15-a3b6cf2a1e23 req-db1f192f-2fa7-4026-a92d-2b6e3f6cd6f8 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received event network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2ccf2278-ff60-4c3b-bf15-a3b6cf2a1e23 req-db1f192f-2fa7-4026-a92d-2b6e3f6cd6f8 service nova] Acquiring lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2ccf2278-ff60-4c3b-bf15-a3b6cf2a1e23 req-db1f192f-2fa7-4026-a92d-2b6e3f6cd6f8 service nova] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2ccf2278-ff60-4c3b-bf15-a3b6cf2a1e23 req-db1f192f-2fa7-4026-a92d-2b6e3f6cd6f8 service nova] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-2ccf2278-ff60-4c3b-bf15-a3b6cf2a1e23 req-db1f192f-2fa7-4026-a92d-2b6e3f6cd6f8 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] No waiting events found dispatching network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:47 user nova-compute[74892]: WARNING nova.compute.manager [req-2ccf2278-ff60-4c3b-bf15-a3b6cf2a1e23 req-db1f192f-2fa7-4026-a92d-2b6e3f6cd6f8 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received unexpected event network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e for instance with vm_state building and task_state spawning.
Nov 15 14:31:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:31:49 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Instance spawned successfully.
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-fe1b3aee-eedc-429d-a179-dd0121960d7f req-23ec7df4-d2cf-4e79-95a8-e12a138da9fd service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received event network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fe1b3aee-eedc-429d-a179-dd0121960d7f req-23ec7df4-d2cf-4e79-95a8-e12a138da9fd service nova] Acquiring lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fe1b3aee-eedc-429d-a179-dd0121960d7f req-23ec7df4-d2cf-4e79-95a8-e12a138da9fd service nova] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fe1b3aee-eedc-429d-a179-dd0121960d7f req-23ec7df4-d2cf-4e79-95a8-e12a138da9fd service nova] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-fe1b3aee-eedc-429d-a179-dd0121960d7f req-23ec7df4-d2cf-4e79-95a8-e12a138da9fd service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] No waiting events found dispatching network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:49 user nova-compute[74892]: WARNING nova.compute.manager [req-fe1b3aee-eedc-429d-a179-dd0121960d7f req-23ec7df4-d2cf-4e79-95a8-e12a138da9fd service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received unexpected event network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e for instance with vm_state building and task_state spawning.
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:50 user nova-compute[74892]: INFO nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 14:31:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:50 user nova-compute[74892]: INFO nova.compute.manager [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Took 10.97 seconds to build instance.
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fe6406f1-c473-4414-a7c5-59ee7bf4982a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.071s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:31:50 user nova-compute[74892]: INFO nova.compute.claims [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Claim successful on node user
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:31:51 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:31:51 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7977MB free_disk=24.954490661621094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Applying migration context for instance 1b456afe-f03e-4856-aa42-634959e5547d as it has an incoming, in-progress migration 06a91167-7b7f-4059-86b8-44d923c15529. Migration status is finished {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 14:31:51 user nova-compute[74892]: INFO nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating resource usage from migration 06a91167-7b7f-4059-86b8-44d923c15529
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:31:51 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Creating image(s)
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "/opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "/opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 144bf11d-fc91-4bcb-9c63-3e11b3d8661b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Migration 06a91167-7b7f-4059-86b8-44d923c15529 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1b456afe-f03e-4856-aa42-634959e5547d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 728aaeb0-c063-49da-8046-575c82f5fe4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:31:51 user nova-compute[74892]: DEBUG nova.policy [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a85e0d65c2248e0aca031055b162e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5649287d611341a7850ed74e51b7bfe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk 1073741824" returned: 0 in 0.078s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.720s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Cannot resize image /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Ensure instance console log exists: /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:52 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Successfully created port: b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Successfully updated port: b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquired lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-2667ce8a-8a24-473a-b05b-41ba658a113c req-6eb2d8ae-5b7e-4b8a-b956-41b39331513d service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received event network-changed-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-2667ce8a-8a24-473a-b05b-41ba658a113c req-6eb2d8ae-5b7e-4b8a-b956-41b39331513d service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Refreshing instance network info cache due to event network-changed-b866e1d3-3fb0-4d4b-8a42-4a6943852329. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2667ce8a-8a24-473a-b05b-41ba658a113c req-6eb2d8ae-5b7e-4b8a-b956-41b39331513d service nova] Acquiring lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Updating instance_info_cache with network_info: [{"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Releasing lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Instance network_info: |[{"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2667ce8a-8a24-473a-b05b-41ba658a113c req-6eb2d8ae-5b7e-4b8a-b956-41b39331513d service nova] Acquired lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.network.neutron [req-2667ce8a-8a24-473a-b05b-41ba658a113c req-6eb2d8ae-5b7e-4b8a-b956-41b39331513d service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Refreshing network info cache for port b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Start _get_guest_xml network_info=[{"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:31:53 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:31:53 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158365474',display_name='tempest-AttachVolumeTestJSON-server-158365474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158365474',id=38,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK55Bow/G8Om8ULZE6a6g5aOuJmUfeurm3zMW6q8qiKqzUQXClDB1x60HQbB5X09xqGBfWGVZ7DRoryUyaQ2T/AaCmVEWcfZPLrntMUCvRu90YHInqbVvxdA9SqxYnsn3w==',key_name='tempest-keypair-172152670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-sc626akd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=6dbf4049-8734-4d46-b3c8-823444a4fdf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=b866e1d3-3fb0-4d4b-8a42-4a6943852329,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb866e1d3-3f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:31:53 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:31:54 user nova-compute[74892]:   <uuid>6dbf4049-8734-4d46-b3c8-823444a4fdf1</uuid>
Nov 15 14:31:54 user nova-compute[74892]:   <name>instance-00000026</name>
Nov 15 14:31:54 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:31:54 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:31:54 user nova-compute[74892]:   <metadata>
Nov 15 14:31:54 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:31:54 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:31:54 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeTestJSON-server-158365474</nova:name>
Nov 15 14:31:54 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:31:53</nova:creationTime>
Nov 15 14:31:54 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:31:54 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:31:54 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:31:54 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:31:54 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:31:54 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:31:54 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:31:54 user nova-compute[74892]:       <nova:owner>
Nov 15 14:31:54 user nova-compute[74892]:         <nova:user uuid="1a85e0d65c2248e0aca031055b162e86">tempest-AttachVolumeTestJSON-1499270628-project-member</nova:user>
Nov 15 14:31:54 user nova-compute[74892]:         <nova:project uuid="5649287d611341a7850ed74e51b7bfe3">tempest-AttachVolumeTestJSON-1499270628</nova:project>
Nov 15 14:31:54 user nova-compute[74892]:       </nova:owner>
Nov 15 14:31:54 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:31:54 user nova-compute[74892]:       <nova:ports>
Nov 15 14:31:54 user nova-compute[74892]:         <nova:port uuid="b866e1d3-3fb0-4d4b-8a42-4a6943852329">
Nov 15 14:31:54 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:31:54 user nova-compute[74892]:         </nova:port>
Nov 15 14:31:54 user nova-compute[74892]:       </nova:ports>
Nov 15 14:31:54 user nova-compute[74892]:     </nova:instance>
Nov 15 14:31:54 user nova-compute[74892]:   </metadata>
Nov 15 14:31:54 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:31:54 user nova-compute[74892]:     <system>
Nov 15 14:31:54 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:31:54 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:31:54 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:31:54 user nova-compute[74892]:       <entry name="serial">6dbf4049-8734-4d46-b3c8-823444a4fdf1</entry>
Nov 15 14:31:54 user nova-compute[74892]:       <entry name="uuid">6dbf4049-8734-4d46-b3c8-823444a4fdf1</entry>
Nov 15 14:31:54 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:31:54 user nova-compute[74892]:     </system>
Nov 15 14:31:54 user nova-compute[74892]:   </sysinfo>
Nov 15 14:31:54 user nova-compute[74892]:   <os>
Nov 15 14:31:54 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:31:54 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:31:54 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:31:54 user nova-compute[74892]:   </os>
Nov 15 14:31:54 user nova-compute[74892]:   <features>
Nov 15 14:31:54 user nova-compute[74892]:     <acpi/>
Nov 15 14:31:54 user nova-compute[74892]:     <apic/>
Nov 15 14:31:54 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:31:54 user nova-compute[74892]:   </features>
Nov 15 14:31:54 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:31:54 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:31:54 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:31:54 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:31:54 user nova-compute[74892]:   </clock>
Nov 15 14:31:54 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:31:54 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:31:54 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:31:54 user nova-compute[74892]:   </cpu>
Nov 15 14:31:54 user nova-compute[74892]:   <devices>
Nov 15 14:31:54 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:31:54 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:31:54 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk"/>
Nov 15 14:31:54 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:31:54 user nova-compute[74892]:     </disk>
Nov 15 14:31:54 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:31:54 user nova-compute[74892]:       <mac address="fa:16:3e:1e:4f:98"/>
Nov 15 14:31:54 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:31:54 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:31:54 user nova-compute[74892]:       <target dev="tapb866e1d3-3f"/>
Nov 15 14:31:54 user nova-compute[74892]:     </interface>
Nov 15 14:31:54 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:31:54 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/console.log" append="off"/>
Nov 15 14:31:54 user nova-compute[74892]:     </serial>
Nov 15 14:31:54 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:31:54 user nova-compute[74892]:     <video>
Nov 15 14:31:54 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:31:54 user nova-compute[74892]:     </video>
Nov 15 14:31:54 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:31:54 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:31:54 user nova-compute[74892]:     </rng>
Nov 15 14:31:54 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:31:54 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:31:54 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:31:54 user nova-compute[74892]:     </memballoon>
Nov 15 14:31:54 user nova-compute[74892]:   </devices>
Nov 15 14:31:54 user nova-compute[74892]: </domain>
Nov 15 14:31:54 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158365474',display_name='tempest-AttachVolumeTestJSON-server-158365474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158365474',id=38,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK55Bow/G8Om8ULZE6a6g5aOuJmUfeurm3zMW6q8qiKqzUQXClDB1x60HQbB5X09xqGBfWGVZ7DRoryUyaQ2T/AaCmVEWcfZPLrntMUCvRu90YHInqbVvxdA9SqxYnsn3w==',key_name='tempest-keypair-172152670',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-sc626akd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:31:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=6dbf4049-8734-4d46-b3c8-823444a4fdf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=b866e1d3-3fb0-4d4b-8a42-4a6943852329,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb866e1d3-3f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG os_vif [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=b866e1d3-3fb0-4d4b-8a42-4a6943852329,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb866e1d3-3f') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d4f39ec-9497-5c9b-ab33-373dd8c4adef', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb866e1d3-3f, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb866e1d3-3f, col_values=(('qos', UUID('28ebf784-feba-43f2-a245-02b1408237e0')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb866e1d3-3f, col_values=(('external_ids', {'iface-id': 'b866e1d3-3fb0-4d4b-8a42-4a6943852329', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:4f:98', 'vm-uuid': '6dbf4049-8734-4d46-b3c8-823444a4fdf1'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:54 user nova-compute[74892]: INFO os_vif [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=b866e1d3-3fb0-4d4b-8a42-4a6943852329,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb866e1d3-3f')
Nov 15 14:31:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No VIF found with MAC fa:16:3e:1e:4f:98, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-2667ce8a-8a24-473a-b05b-41ba658a113c req-6eb2d8ae-5b7e-4b8a-b956-41b39331513d service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Updated VIF entry in instance network info cache for port b866e1d3-3fb0-4d4b-8a42-4a6943852329. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-2667ce8a-8a24-473a-b05b-41ba658a113c req-6eb2d8ae-5b7e-4b8a-b956-41b39331513d service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Updating instance_info_cache with network_info: [{"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2667ce8a-8a24-473a-b05b-41ba658a113c req-6eb2d8ae-5b7e-4b8a-b956-41b39331513d service nova] Releasing lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-69ee8f78-f3b3-4c24-88d2-74bf10e1efc8 req-f09f09a8-d31a-4c97-b296-f79e234e443b service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received event network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-69ee8f78-f3b3-4c24-88d2-74bf10e1efc8 req-f09f09a8-d31a-4c97-b296-f79e234e443b service nova] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-69ee8f78-f3b3-4c24-88d2-74bf10e1efc8 req-f09f09a8-d31a-4c97-b296-f79e234e443b service nova] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-69ee8f78-f3b3-4c24-88d2-74bf10e1efc8 req-f09f09a8-d31a-4c97-b296-f79e234e443b service nova] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-69ee8f78-f3b3-4c24-88d2-74bf10e1efc8 req-f09f09a8-d31a-4c97-b296-f79e234e443b service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] No waiting events found dispatching network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:55 user nova-compute[74892]: WARNING nova.compute.manager [req-69ee8f78-f3b3-4c24-88d2-74bf10e1efc8 req-f09f09a8-d31a-4c97-b296-f79e234e443b service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received unexpected event network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 for instance with vm_state building and task_state spawning.
Nov 15 14:31:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:56 user nova-compute[74892]: INFO nova.compute.manager [None req-9365ebba-a66f-4267-ad14-416420bbf28c tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Unrescuing
Nov 15 14:31:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9365ebba-a66f-4267-ad14-416420bbf28c tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9365ebba-a66f-4267-ad14-416420bbf28c tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquired lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9365ebba-a66f-4267-ad14-416420bbf28c tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG nova.network.neutron [None req-9365ebba-a66f-4267-ad14-416420bbf28c tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Updating instance_info_cache with network_info: [{"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9365ebba-a66f-4267-ad14-416420bbf28c tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Releasing lock "refresh_cache-144bf11d-fc91-4bcb-9c63-3e11b3d8661b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG nova.objects.instance [None req-9365ebba-a66f-4267-ad14-416420bbf28c tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'flavor' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:56 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating instance_info_cache with network_info: [{"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-8fbd39df-d62a-4d1b-ac46-f0a2503a3987" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-52b2cce1-d22d-49cd-956d-23b74845be79 req-279d7a52-b233-4bfc-836a-b093147ec105 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-52b2cce1-d22d-49cd-956d-23b74845be79 req-279d7a52-b233-4bfc-836a-b093147ec105 service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-52b2cce1-d22d-49cd-956d-23b74845be79 req-279d7a52-b233-4bfc-836a-b093147ec105 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-52b2cce1-d22d-49cd-956d-23b74845be79 req-279d7a52-b233-4bfc-836a-b093147ec105 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-52b2cce1-d22d-49cd-956d-23b74845be79 req-279d7a52-b233-4bfc-836a-b093147ec105 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:57 user nova-compute[74892]: WARNING nova.compute.manager [req-52b2cce1-d22d-49cd-956d-23b74845be79 req-279d7a52-b233-4bfc-836a-b093147ec105 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:31:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance destroyed successfully.
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:31:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Instance spawned successfully.
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:31:57 user nova-compute[74892]: INFO nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-1ce50532-7ee8-4755-9796-71cc94a4351f req-a382f1d9-82a4-4328-b714-99b7ed2423f4 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received event network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1ce50532-7ee8-4755-9796-71cc94a4351f req-a382f1d9-82a4-4328-b714-99b7ed2423f4 service nova] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1ce50532-7ee8-4755-9796-71cc94a4351f req-a382f1d9-82a4-4328-b714-99b7ed2423f4 service nova] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1ce50532-7ee8-4755-9796-71cc94a4351f req-a382f1d9-82a4-4328-b714-99b7ed2423f4 service nova] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-1ce50532-7ee8-4755-9796-71cc94a4351f req-a382f1d9-82a4-4328-b714-99b7ed2423f4 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] No waiting events found dispatching network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:57 user nova-compute[74892]: WARNING nova.compute.manager [req-1ce50532-7ee8-4755-9796-71cc94a4351f req-a382f1d9-82a4-4328-b714-99b7ed2423f4 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received unexpected event network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 for instance with vm_state building and task_state spawning.
Nov 15 14:31:57 user nova-compute[74892]: INFO nova.compute.manager [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Took 7.15 seconds to build instance.
Nov 15 14:31:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c6077e05-2b00-4058-9f11-ed01ffed193a tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.269s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:59 user nova-compute[74892]: WARNING nova.compute.manager [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:31:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:31:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:31:59 user nova-compute[74892]: WARNING nova.compute.manager [req-890789c3-b76f-4fe7-90a5-b5cf8ed1943c req-9891e8c2-1242-4d21-956b-496345f76a8c service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:32:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9365ebba-a66f-4267-ad14-416420bbf28c tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:32:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-91d70a5a-3728-44d4-9d32-6d156406cd16 req-217b4533-199c-4172-a814-410993800015 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:32:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-91d70a5a-3728-44d4-9d32-6d156406cd16 req-217b4533-199c-4172-a814-410993800015 service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-91d70a5a-3728-44d4-9d32-6d156406cd16 req-217b4533-199c-4172-a814-410993800015 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-91d70a5a-3728-44d4-9d32-6d156406cd16 req-217b4533-199c-4172-a814-410993800015 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-91d70a5a-3728-44d4-9d32-6d156406cd16 req-217b4533-199c-4172-a814-410993800015 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:32:01 user nova-compute[74892]: WARNING nova.compute.manager [req-91d70a5a-3728-44d4-9d32-6d156406cd16 req-217b4533-199c-4172-a814-410993800015 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state active and task_state None.
Nov 15 14:32:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Going to confirm migration 2 {{(pid=74892) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 14:32:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:32:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquired lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:32:04 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:32:04 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'info_cache' on Instance uuid 1b456afe-f03e-4856-aa42-634959e5547d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating instance_info_cache with network_info: [{"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Releasing lock "refresh_cache-1b456afe-f03e-4856-aa42-634959e5547d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'migration_context' on Instance uuid 1b456afe-f03e-4856-aa42-634959e5547d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG nova.objects.base [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Object Instance<1b456afe-f03e-4856-aa42-634959e5547d> lazy-loaded attributes: info_cache,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:32:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.399s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:06 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Deleted allocation for migration 06a91167-7b7f-4059-86b8-44d923c15529
Nov 15 14:32:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d975e678-5088-4a94-bd8d-0295903a0980 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.333s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:32:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:10 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:32:10 user nova-compute[74892]: INFO nova.compute.claims [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Claim successful on node user
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:32:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.policy [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '494e2c6ede5c47ed8af6d1399ad8a06a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c2d5b81e2d940589392aa33ffb900e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:32:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Creating image(s)
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "/opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "/opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "/opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk 1073741824" returned: 0 in 0.059s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Successfully created port: 8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Checking if we can resize image /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Cannot resize image /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Ensure instance console log exists: /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Successfully updated port: 8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquired lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-ee5368fb-db09-4d2f-bf1e-9af5fcccf7e4 req-8355e119-03fd-43e1-a346-caec595d478e service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received event network-changed-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-ee5368fb-db09-4d2f-bf1e-9af5fcccf7e4 req-8355e119-03fd-43e1-a346-caec595d478e service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Refreshing instance network info cache due to event network-changed-8066b09b-2f4a-4365-ad3f-1d3d2650222c. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ee5368fb-db09-4d2f-bf1e-9af5fcccf7e4 req-8355e119-03fd-43e1-a346-caec595d478e service nova] Acquiring lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Updating instance_info_cache with network_info: [{"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Releasing lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Instance network_info: |[{"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ee5368fb-db09-4d2f-bf1e-9af5fcccf7e4 req-8355e119-03fd-43e1-a346-caec595d478e service nova] Acquired lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.neutron [req-ee5368fb-db09-4d2f-bf1e-9af5fcccf7e4 req-8355e119-03fd-43e1-a346-caec595d478e service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Refreshing network info cache for port 8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Start _get_guest_xml network_info=[{"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:32:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:32:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102294138',display_name='tempest-AttachVolumeNegativeTest-server-1102294138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102294138',id=39,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5I0rrkpSDEBi38/RcSuEZ9L0+guNBPC8pKx7O3WgYJlJHdwmUdhZs09ma63T6m33wRQbB4i4uMqJmU0lrjHOgPjgoll4GwWmT8UuJp4n+eFMO8UMqPgdryAJ4zU+IvdA==',key_name='tempest-keypair-1923963830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-w46bf48c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=daeb5cce-969d-4671-872d-4c68f593d0da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:fb,bridge_name='br-int',has_traffic_filtering=True,id=8066b09b-2f4a-4365-ad3f-1d3d2650222c,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8066b09b-2f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'pci_devices' on Instance uuid daeb5cce-969d-4671-872d-4c68f593d0da {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:32:12 user nova-compute[74892]:   <uuid>daeb5cce-969d-4671-872d-4c68f593d0da</uuid>
Nov 15 14:32:12 user nova-compute[74892]:   <name>instance-00000027</name>
Nov 15 14:32:12 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:32:12 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:32:12 user nova-compute[74892]:   <metadata>
Nov 15 14:32:12 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:32:12 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:32:12 user nova-compute[74892]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1102294138</nova:name>
Nov 15 14:32:12 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:32:12</nova:creationTime>
Nov 15 14:32:12 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:32:12 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:32:12 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:32:12 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:32:12 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:32:12 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:32:12 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:32:12 user nova-compute[74892]:       <nova:owner>
Nov 15 14:32:12 user nova-compute[74892]:         <nova:user uuid="494e2c6ede5c47ed8af6d1399ad8a06a">tempest-AttachVolumeNegativeTest-2132166828-project-member</nova:user>
Nov 15 14:32:12 user nova-compute[74892]:         <nova:project uuid="6c2d5b81e2d940589392aa33ffb900e2">tempest-AttachVolumeNegativeTest-2132166828</nova:project>
Nov 15 14:32:12 user nova-compute[74892]:       </nova:owner>
Nov 15 14:32:12 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:32:12 user nova-compute[74892]:       <nova:ports>
Nov 15 14:32:12 user nova-compute[74892]:         <nova:port uuid="8066b09b-2f4a-4365-ad3f-1d3d2650222c">
Nov 15 14:32:12 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 14:32:12 user nova-compute[74892]:         </nova:port>
Nov 15 14:32:12 user nova-compute[74892]:       </nova:ports>
Nov 15 14:32:12 user nova-compute[74892]:     </nova:instance>
Nov 15 14:32:12 user nova-compute[74892]:   </metadata>
Nov 15 14:32:12 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:32:12 user nova-compute[74892]:     <system>
Nov 15 14:32:12 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:32:12 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:32:12 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:32:12 user nova-compute[74892]:       <entry name="serial">daeb5cce-969d-4671-872d-4c68f593d0da</entry>
Nov 15 14:32:12 user nova-compute[74892]:       <entry name="uuid">daeb5cce-969d-4671-872d-4c68f593d0da</entry>
Nov 15 14:32:12 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:32:12 user nova-compute[74892]:     </system>
Nov 15 14:32:12 user nova-compute[74892]:   </sysinfo>
Nov 15 14:32:12 user nova-compute[74892]:   <os>
Nov 15 14:32:12 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:32:12 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:32:12 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:32:12 user nova-compute[74892]:   </os>
Nov 15 14:32:12 user nova-compute[74892]:   <features>
Nov 15 14:32:12 user nova-compute[74892]:     <acpi/>
Nov 15 14:32:12 user nova-compute[74892]:     <apic/>
Nov 15 14:32:12 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:32:12 user nova-compute[74892]:   </features>
Nov 15 14:32:12 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:32:12 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:32:12 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:32:12 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:32:12 user nova-compute[74892]:   </clock>
Nov 15 14:32:12 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:32:12 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:32:12 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:32:12 user nova-compute[74892]:   </cpu>
Nov 15 14:32:12 user nova-compute[74892]:   <devices>
Nov 15 14:32:12 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:32:12 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:32:12 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk"/>
Nov 15 14:32:12 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:32:12 user nova-compute[74892]:     </disk>
Nov 15 14:32:12 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:32:12 user nova-compute[74892]:       <mac address="fa:16:3e:e5:56:fb"/>
Nov 15 14:32:12 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:32:12 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:32:12 user nova-compute[74892]:       <target dev="tap8066b09b-2f"/>
Nov 15 14:32:12 user nova-compute[74892]:     </interface>
Nov 15 14:32:12 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:32:12 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/console.log" append="off"/>
Nov 15 14:32:12 user nova-compute[74892]:     </serial>
Nov 15 14:32:12 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:32:12 user nova-compute[74892]:     <video>
Nov 15 14:32:12 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:32:12 user nova-compute[74892]:     </video>
Nov 15 14:32:12 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:32:12 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:32:12 user nova-compute[74892]:     </rng>
Nov 15 14:32:12 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:32:12 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:32:12 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:32:12 user nova-compute[74892]:     </memballoon>
Nov 15 14:32:12 user nova-compute[74892]:   </devices>
Nov 15 14:32:12 user nova-compute[74892]: </domain>
Nov 15 14:32:12 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102294138',display_name='tempest-AttachVolumeNegativeTest-server-1102294138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102294138',id=39,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5I0rrkpSDEBi38/RcSuEZ9L0+guNBPC8pKx7O3WgYJlJHdwmUdhZs09ma63T6m33wRQbB4i4uMqJmU0lrjHOgPjgoll4GwWmT8UuJp4n+eFMO8UMqPgdryAJ4zU+IvdA==',key_name='tempest-keypair-1923963830',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-w46bf48c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:32:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=daeb5cce-969d-4671-872d-4c68f593d0da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:fb,bridge_name='br-int',has_traffic_filtering=True,id=8066b09b-2f4a-4365-ad3f-1d3d2650222c,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8066b09b-2f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG os_vif [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:fb,bridge_name='br-int',has_traffic_filtering=True,id=8066b09b-2f4a-4365-ad3f-1d3d2650222c,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8066b09b-2f') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf93be5c-c2b2-58cd-a04e-e42d1fcccc99', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8066b09b-2f, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8066b09b-2f, col_values=(('qos', UUID('9ad7686d-e632-4b2c-b362-2bad18da626f')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8066b09b-2f, col_values=(('external_ids', {'iface-id': '8066b09b-2f4a-4365-ad3f-1d3d2650222c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:56:fb', 'vm-uuid': 'daeb5cce-969d-4671-872d-4c68f593d0da'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:12 user nova-compute[74892]: INFO os_vif [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:56:fb,bridge_name='br-int',has_traffic_filtering=True,id=8066b09b-2f4a-4365-ad3f-1d3d2650222c,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8066b09b-2f')
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:32:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No VIF found with MAC fa:16:3e:e5:56:fb, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:32:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-ee5368fb-db09-4d2f-bf1e-9af5fcccf7e4 req-8355e119-03fd-43e1-a346-caec595d478e service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Updated VIF entry in instance network info cache for port 8066b09b-2f4a-4365-ad3f-1d3d2650222c. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:32:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-ee5368fb-db09-4d2f-bf1e-9af5fcccf7e4 req-8355e119-03fd-43e1-a346-caec595d478e service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Updating instance_info_cache with network_info: [{"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:32:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ee5368fb-db09-4d2f-bf1e-9af5fcccf7e4 req-8355e119-03fd-43e1-a346-caec595d478e service nova] Releasing lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-2733187f-9428-42c2-a390-a64e77cb3342 req-0c60ee9a-d96c-475d-8e98-5db237b9e704 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received event network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2733187f-9428-42c2-a390-a64e77cb3342 req-0c60ee9a-d96c-475d-8e98-5db237b9e704 service nova] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2733187f-9428-42c2-a390-a64e77cb3342 req-0c60ee9a-d96c-475d-8e98-5db237b9e704 service nova] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2733187f-9428-42c2-a390-a64e77cb3342 req-0c60ee9a-d96c-475d-8e98-5db237b9e704 service nova] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-2733187f-9428-42c2-a390-a64e77cb3342 req-0c60ee9a-d96c-475d-8e98-5db237b9e704 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] No waiting events found dispatching network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:32:14 user nova-compute[74892]: WARNING nova.compute.manager [req-2733187f-9428-42c2-a390-a64e77cb3342 req-0c60ee9a-d96c-475d-8e98-5db237b9e704 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received unexpected event network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c for instance with vm_state building and task_state spawning.
Nov 15 14:32:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:32:16 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Instance spawned successfully.
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:32:16 user nova-compute[74892]: INFO nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:32:16 user nova-compute[74892]: INFO nova.compute.manager [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Took 5.87 seconds to build instance.
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-883a64b1-06d0-4887-b5ba-3a28b2f81539 req-e96fc6b2-d341-47ba-aa3e-753ace9183e9 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received event network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-883a64b1-06d0-4887-b5ba-3a28b2f81539 req-e96fc6b2-d341-47ba-aa3e-753ace9183e9 service nova] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-883a64b1-06d0-4887-b5ba-3a28b2f81539 req-e96fc6b2-d341-47ba-aa3e-753ace9183e9 service nova] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-883a64b1-06d0-4887-b5ba-3a28b2f81539 req-e96fc6b2-d341-47ba-aa3e-753ace9183e9 service nova] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-883a64b1-06d0-4887-b5ba-3a28b2f81539 req-e96fc6b2-d341-47ba-aa3e-753ace9183e9 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] No waiting events found dispatching network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:32:16 user nova-compute[74892]: WARNING nova.compute.manager [req-883a64b1-06d0-4887-b5ba-3a28b2f81539 req-e96fc6b2-d341-47ba-aa3e-753ace9183e9 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received unexpected event network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c for instance with vm_state active and task_state None.
Nov 15 14:32:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-72bd3759-980e-4fd7-8540-75cac45dbef5 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.017s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:46 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:46 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:32:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:32:46 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:32:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:32:50 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:32:50 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7487MB free_disk=24.887638092041016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 144bf11d-fc91-4bcb-9c63-3e11b3d8661b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1b456afe-f03e-4856-aa42-634959e5547d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 728aaeb0-c063-49da-8046-575c82f5fe4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance daeb5cce-969d-4671-872d-4c68f593d0da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:32:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:32:51 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:32:51 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:32:51 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:32:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:32:52 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:32:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:32:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:32:52 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:32:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:32:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Updating instance_info_cache with network_info: [{"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:32:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-a80d8849-d199-4b95-9c3b-d673bd0ded3c" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:32:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:32:53 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:53 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:32:53 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:32:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:32:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:32:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:32:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:33:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:33:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:33:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:33:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:33:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:15 user nova-compute[74892]: INFO nova.compute.manager [None req-bf8294cc-9869-4ef7-971f-94200e2fc76b tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Unrescuing
Nov 15 14:33:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bf8294cc-9869-4ef7-971f-94200e2fc76b tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:33:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bf8294cc-9869-4ef7-971f-94200e2fc76b tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquired lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:33:15 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bf8294cc-9869-4ef7-971f-94200e2fc76b tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bf8294cc-9869-4ef7-971f-94200e2fc76b tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updating instance_info_cache with network_info: [{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bf8294cc-9869-4ef7-971f-94200e2fc76b tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Releasing lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bf8294cc-9869-4ef7-971f-94200e2fc76b tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'flavor' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-41e82f04-82de-4a43-b2ff-0c0ed16f52f8 req-7d1d05d1-0869-489d-841a-d3e40f6202cd service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-41e82f04-82de-4a43-b2ff-0c0ed16f52f8 req-7d1d05d1-0869-489d-841a-d3e40f6202cd service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-41e82f04-82de-4a43-b2ff-0c0ed16f52f8 req-7d1d05d1-0869-489d-841a-d3e40f6202cd service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-41e82f04-82de-4a43-b2ff-0c0ed16f52f8 req-7d1d05d1-0869-489d-841a-d3e40f6202cd service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-41e82f04-82de-4a43-b2ff-0c0ed16f52f8 req-7d1d05d1-0869-489d-841a-d3e40f6202cd service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:16 user nova-compute[74892]: WARNING nova.compute.manager [req-41e82f04-82de-4a43-b2ff-0c0ed16f52f8 req-7d1d05d1-0869-489d-841a-d3e40f6202cd service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:16 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance destroyed successfully.
Nov 15 14:33:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:18 user nova-compute[74892]: WARNING nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:18 user nova-compute[74892]: WARNING nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:18 user nova-compute[74892]: WARNING nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:18 user nova-compute[74892]: WARNING nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:18 user nova-compute[74892]: WARNING nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:18 user nova-compute[74892]: WARNING nova.compute.manager [req-e4518678-630e-4082-a10a-d3025aa21431 req-ad510dee-fb12-4a68-8b54-975f15f4cfa8 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:33:20 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bf8294cc-9869-4ef7-971f-94200e2fc76b tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:33:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-37857b39-9043-4c89-a45b-9ac52954db73 req-9ad06e44-0eac-4c1c-a477-21c11d03625a service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37857b39-9043-4c89-a45b-9ac52954db73 req-9ad06e44-0eac-4c1c-a477-21c11d03625a service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37857b39-9043-4c89-a45b-9ac52954db73 req-9ad06e44-0eac-4c1c-a477-21c11d03625a service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37857b39-9043-4c89-a45b-9ac52954db73 req-9ad06e44-0eac-4c1c-a477-21c11d03625a service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-37857b39-9043-4c89-a45b-9ac52954db73 req-9ad06e44-0eac-4c1c-a477-21c11d03625a service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:20 user nova-compute[74892]: WARNING nova.compute.manager [req-37857b39-9043-4c89-a45b-9ac52954db73 req-9ad06e44-0eac-4c1c-a477-21c11d03625a service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state active and task_state None.
Nov 15 14:33:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:33:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:33:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:33:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:33:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-c5e94bad-fb0e-4304-912d-804e22b7e92b req-e6417089-f3a5-4ca0-a071-9a1cd577dcaf service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received event network-changed-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-c5e94bad-fb0e-4304-912d-804e22b7e92b req-e6417089-f3a5-4ca0-a071-9a1cd577dcaf service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Refreshing instance network info cache due to event network-changed-2971fb38-d954-4b27-8994-099dededaa9e. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:33:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c5e94bad-fb0e-4304-912d-804e22b7e92b req-e6417089-f3a5-4ca0-a071-9a1cd577dcaf service nova] Acquiring lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:33:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c5e94bad-fb0e-4304-912d-804e22b7e92b req-e6417089-f3a5-4ca0-a071-9a1cd577dcaf service nova] Acquired lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:33:30 user nova-compute[74892]: DEBUG nova.network.neutron [req-c5e94bad-fb0e-4304-912d-804e22b7e92b req-e6417089-f3a5-4ca0-a071-9a1cd577dcaf service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Refreshing network info cache for port 2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:33:30 user nova-compute[74892]: DEBUG nova.network.neutron [req-c5e94bad-fb0e-4304-912d-804e22b7e92b req-e6417089-f3a5-4ca0-a071-9a1cd577dcaf service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Updated VIF entry in instance network info cache for port 2971fb38-d954-4b27-8994-099dededaa9e. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:33:30 user nova-compute[74892]: DEBUG nova.network.neutron [req-c5e94bad-fb0e-4304-912d-804e22b7e92b req-e6417089-f3a5-4ca0-a071-9a1cd577dcaf service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Updating instance_info_cache with network_info: [{"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:33:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c5e94bad-fb0e-4304-912d-804e22b7e92b req-e6417089-f3a5-4ca0-a071-9a1cd577dcaf service nova] Releasing lock "refresh_cache-728aaeb0-c063-49da-8046-575c82f5fe4b" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:33:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c7757be7-596d-4e19-a909-362703d903a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:36 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:33:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:33:37 user nova-compute[74892]: INFO nova.compute.claims [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Claim successful on node user
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:33:37 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:33:37 user nova-compute[74892]: INFO nova.virt.block_device [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Booting with volume snapshot 97dc5818-897c-4d30-ad08-9204fe0e98a5 at /dev/vda
Nov 15 14:33:37 user nova-compute[74892]: DEBUG nova.policy [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c73da782783d41dbb370c3df04dec208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdd6323d06f4337995cbb796778b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:33:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Successfully created port: 2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Successfully updated port: 2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquired lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-c449eb71-b966-438d-a92f-c23239fc80c8 req-85b43499-72c2-430c-b90a-bc7ca2df049e service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-changed-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-c449eb71-b966-438d-a92f-c23239fc80c8 req-85b43499-72c2-430c-b90a-bc7ca2df049e service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Refreshing instance network info cache due to event network-changed-2f5ad71a-e731-40f9-9895-728ca6306197. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c449eb71-b966-438d-a92f-c23239fc80c8 req-85b43499-72c2-430c-b90a-bc7ca2df049e service nova] Acquiring lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:33:38 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:33:39 user nova-compute[74892]: DEBUG nova.network.neutron [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Updating instance_info_cache with network_info: [{"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:33:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Releasing lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:33:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Instance network_info: |[{"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:33:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c449eb71-b966-438d-a92f-c23239fc80c8 req-85b43499-72c2-430c-b90a-bc7ca2df049e service nova] Acquired lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:33:39 user nova-compute[74892]: DEBUG nova.network.neutron [req-c449eb71-b966-438d-a92f-c23239fc80c8 req-85b43499-72c2-430c-b90a-bc7ca2df049e service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Refreshing network info cache for port 2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:33:39 user nova-compute[74892]: DEBUG nova.network.neutron [req-c449eb71-b966-438d-a92f-c23239fc80c8 req-85b43499-72c2-430c-b90a-bc7ca2df049e service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Updated VIF entry in instance network info cache for port 2f5ad71a-e731-40f9-9895-728ca6306197. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:33:39 user nova-compute[74892]: DEBUG nova.network.neutron [req-c449eb71-b966-438d-a92f-c23239fc80c8 req-85b43499-72c2-430c-b90a-bc7ca2df049e service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Updating instance_info_cache with network_info: [{"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:33:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c449eb71-b966-438d-a92f-c23239fc80c8 req-85b43499-72c2-430c-b90a-bc7ca2df049e service nova] Releasing lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-5763967d-9bcf-4408-a310-2f104a06c6da req-348d495e-49a5-498a-a805-60e8b10d8144 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received event network-changed-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-5763967d-9bcf-4408-a310-2f104a06c6da req-348d495e-49a5-498a-a805-60e8b10d8144 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Refreshing instance network info cache due to event network-changed-b866e1d3-3fb0-4d4b-8a42-4a6943852329. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5763967d-9bcf-4408-a310-2f104a06c6da req-348d495e-49a5-498a-a805-60e8b10d8144 service nova] Acquiring lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5763967d-9bcf-4408-a310-2f104a06c6da req-348d495e-49a5-498a-a805-60e8b10d8144 service nova] Acquired lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.network.neutron [req-5763967d-9bcf-4408-a310-2f104a06c6da req-348d495e-49a5-498a-a805-60e8b10d8144 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Refreshing network info cache for port b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.network.neutron [req-5763967d-9bcf-4408-a310-2f104a06c6da req-348d495e-49a5-498a-a805-60e8b10d8144 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Updated VIF entry in instance network info cache for port b866e1d3-3fb0-4d4b-8a42-4a6943852329. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.network.neutron [req-5763967d-9bcf-4408-a310-2f104a06c6da req-348d495e-49a5-498a-a805-60e8b10d8144 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Updating instance_info_cache with network_info: [{"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5763967d-9bcf-4408-a310-2f104a06c6da req-348d495e-49a5-498a-a805-60e8b10d8144 service nova] Releasing lock "refresh_cache-6dbf4049-8734-4d46-b3c8-823444a4fdf1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:41 user nova-compute[74892]: WARNING nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid a87f39af-29c7-40ee-86c9-ed04a07b9d2e {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 6c7fcea3-5818-4f0d-a0e8-91bef820d398 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:41 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid a80d8849-d199-4b95-9c3b-d673bd0ded3c {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 1b456afe-f03e-4856-aa42-634959e5547d {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 728aaeb0-c063-49da-8046-575c82f5fe4b {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid daeb5cce-969d-4671-872d-4c68f593d0da {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid c7757be7-596d-4e19-a909-362703d903a6 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "9a85430d-53e3-4181-9588-158654fe008d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "1b456afe-f03e-4856-aa42-634959e5547d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "728aaeb0-c063-49da-8046-575c82f5fe4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "9a85430d-53e3-4181-9588-158654fe008d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "1b456afe-f03e-4856-aa42-634959e5547d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[241399c7-107c-428b-a1a5-166d25eaa0f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82fe9b6-377e-4c38-9f71-ef4aad4f0c7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b87ff4-e1cd-4032-b524-324ab1d635b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27c54d5-4cbc-46e3-9512-b5534179ba89]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:33:43 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4264e29-655d-4c8f-a651-f461b98f1cb2]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Updating existing volume attachment record: c948346e-f63f-42ec-8a8e-687919b5ec7d {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:43 user nova-compute[74892]: DEBUG nova.objects.instance [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.134s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:44 user nova-compute[74892]: INFO nova.compute.manager [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Attaching volume 759e963b-ce56-4288-800f-16bc91000f9c to /dev/vdb
Nov 15 14:33:44 user nova-compute[74892]: DEBUG os_brick.utils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0dbe0c-cc20-4a5b-a817-37e44e405509]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[888c18e9-f202-4511-aa13-825c4a85c846]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de0ddb7-7c2f-4fe7-8d61-56dc330e1289]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc07da7-3b42-4fda-9fcc-01d173a0d8ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:33:44 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:33:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[523236be-8661-4d4c-949b-1615d2bae5d7]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG os_brick.utils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:33:44 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Updating existing volume attachment record: 8e205363-b015-4f1f-856e-bb65a8ac944f {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:33:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:47 user nova-compute[74892]: INFO nova.compute.manager [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Terminating instance
Nov 15 14:33:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-8c45d1d4-ea72-4484-ab99-3391916c29a6 req-07000c83-c344-4dc6-ba07-e7f7bbea4daa service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8c45d1d4-ea72-4484-ab99-3391916c29a6 req-07000c83-c344-4dc6-ba07-e7f7bbea4daa service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8c45d1d4-ea72-4484-ab99-3391916c29a6 req-07000c83-c344-4dc6-ba07-e7f7bbea4daa service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8c45d1d4-ea72-4484-ab99-3391916c29a6 req-07000c83-c344-4dc6-ba07-e7f7bbea4daa service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-8c45d1d4-ea72-4484-ab99-3391916c29a6 req-07000c83-c344-4dc6-ba07-e7f7bbea4daa service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-8c45d1d4-ea72-4484-ab99-3391916c29a6 req-07000c83-c344-4dc6-ba07-e7f7bbea4daa service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-unplugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Instance destroyed successfully.
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.objects.instance [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'resources' on Instance uuid 144bf11d-fc91-4bcb-9c63-3e11b3d8661b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1598376678',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1598376678',id=33,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:30:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-pamncegq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:32:01Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=144bf11d-fc91-4bcb-9c63-3e11b3d8661b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "b3d70342-7983-4724-8efd-b482ab015807", "address": "fa:16:3e:0e:20:e4", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3d70342-79", "ovs_interfaceid": "b3d70342-7983-4724-8efd-b482ab015807", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:20:e4,bridge_name='br-int',has_traffic_filtering=True,id=b3d70342-7983-4724-8efd-b482ab015807,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d70342-79') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_vif [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:20:e4,bridge_name='br-int',has_traffic_filtering=True,id=b3d70342-7983-4724-8efd-b482ab015807,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d70342-79') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3d70342-79, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dc8305d-9a67-4d0b-994e-f29944dcb26a) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:48 user nova-compute[74892]: INFO os_vif [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:20:e4,bridge_name='br-int',has_traffic_filtering=True,id=b3d70342-7983-4724-8efd-b482ab015807,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3d70342-79')
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QxXKCWjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:33:48 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea0f99f-7c5a-4c25-832e-13ca25e38521]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:33:48 user nova-compute[74892]: No targets found.
Nov 15 14:33:48 user nova-compute[74892]: iSNS:
Nov 15 14:33:48 user nova-compute[74892]: No targets found.
Nov 15 14:33:48 user nova-compute[74892]: STATIC:
Nov 15 14:33:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc
Nov 15 14:33:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:33:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:33:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74
Nov 15 14:33:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:33:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:33:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:33:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:33:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:33:48 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:33:48 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:33:48 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:33:48 user nova-compute[74892]: FIRMWARE:
Nov 15 14:33:48 user nova-compute[74892]: No targets found.
Nov 15 14:33:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:33:48 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:33:48 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f1965b-d376-4d85-be15-5099e3810c7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[821f6ae6-2e82-4d87-8928-803dadf0b0c9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:48 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:33:48 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:48 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:48 user nova-compute[74892]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc (non-flash)
Nov 15 14:33:48 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:48 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2016ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a41da7e-89a9-4845-a28b-d934ca8c1a2e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01c0bc4-e96f-40c3-bf39-87834aa67773]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b1fb18-7e1d-42fd-95ba-515b99c67e19]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563fbfd-9f25-49a7-8a74-80ecb594415b]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26537356636613931', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f9e36bdd', '/dev/disk/by-id/scsi-1SCST_BIOf9e36bdd-e75f6a9194789ae2') {{(pid=85038) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb8e424-c80a-49aa-bc29-f62e6a4a6612]: (4, None) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6b402b-92de-43bf-a800-f0b9ea7441c0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb7e166-1572-4afa-9def-566bb8609731]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc, portal: 172.16.0.220,3260]
Nov 15 14:33:48 user nova-compute[74892]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc, portal: 172.16.0.220,3260] successful.
Nov 15 14:33:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ddb1715-360f-47d9-9c13-ceadfd15e6bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[59771a66-a346-4428-803a-05508e9aa71a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] <== disconnect_volume: return (355ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:33:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Deleting instance files /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b_del
Nov 15 14:33:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Deletion of /opt/stack/data/nova/instances/144bf11d-fc91-4bcb-9c63-3e11b3d8661b_del complete
Nov 15 14:33:48 user nova-compute[74892]: INFO nova.compute.manager [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:33:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-ad411c78-7f72-490d-ae59-b0a600fe30b8 req-1e391722-eeaa-4053-ad0e-a8b5b459bc70 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-deleted-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:49 user nova-compute[74892]: INFO nova.compute.manager [req-ad411c78-7f72-490d-ae59-b0a600fe30b8 req-1e391722-eeaa-4053-ad0e-a8b5b459bc70 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Neutron deleted interface b3d70342-7983-4724-8efd-b482ab015807; detaching it from the instance and deleting it from the info cache
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.network.neutron [req-ad411c78-7f72-490d-ae59-b0a600fe30b8 req-1e391722-eeaa-4053-ad0e-a8b5b459bc70 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:33:49 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Took 0.74 seconds to deallocate network for instance.
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-ad411c78-7f72-490d-ae59-b0a600fe30b8 req-1e391722-eeaa-4053-ad0e-a8b5b459bc70 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Detach interface failed, port_id=b3d70342-7983-4724-8efd-b482ab015807, reason: Instance 144bf11d-fc91-4bcb-9c63-3e11b3d8661b could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-41a3f81e-fc99-4d71-8a06-7d3bb0ea90db req-9ea6dea6-9bae-4345-aea2-09a9a5326653 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-41a3f81e-fc99-4d71-8a06-7d3bb0ea90db req-9ea6dea6-9bae-4345-aea2-09a9a5326653 service nova] Acquiring lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-41a3f81e-fc99-4d71-8a06-7d3bb0ea90db req-9ea6dea6-9bae-4345-aea2-09a9a5326653 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-41a3f81e-fc99-4d71-8a06-7d3bb0ea90db req-9ea6dea6-9bae-4345-aea2-09a9a5326653 service nova] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-41a3f81e-fc99-4d71-8a06-7d3bb0ea90db req-9ea6dea6-9bae-4345-aea2-09a9a5326653 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] No waiting events found dispatching network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:49 user nova-compute[74892]: WARNING nova.compute.manager [req-41a3f81e-fc99-4d71-8a06-7d3bb0ea90db req-9ea6dea6-9bae-4345-aea2-09a9a5326653 service nova] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Received unexpected event network-vif-plugged-b3d70342-7983-4724-8efd-b482ab015807 for instance with vm_state active and task_state deleting.
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:33:49 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Creating image(s)
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Ensure instance console log exists: /opt/stack/data/nova/instances/c7757be7-596d-4e19-a909-362703d903a6/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Start _get_guest_xml network_info=[{"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T14:33:33Z,direct_url=<?>,disk_format='qcow2',id=5543328b-0f3d-4299-812f-7644ecf69938,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-188909248',owner='1cdd6323d06f4337995cbb796778b449',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T14:33:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQEJFcTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7757be7-596d-4e19-a909-362703d903a6', 'attached_at': '', 'detached_at': '', 'volume_id': '6999e542-84fa-4fc0-9e1c-74b9473604fc', 'serial': '6999e542-84fa-4fc0-9e1c-74b9473604fc'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'c948346e-f63f-42ec-8a8e-687919b5ec7d', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:33:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:33:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T14:33:33Z,direct_url=<?>,disk_format='qcow2',id=5543328b-0f3d-4299-812f-7644ecf69938,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-188909248',owner='1cdd6323d06f4337995cbb796778b449',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T14:33:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQEJFcTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:33:49 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:33:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:33:49 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:33:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:33:49 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba3c6c5-91b1-4b11-a404-82a07241d083]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:33:49 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2516c52-5366-40c6-9465-9dbc132a52df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc] added
Nov 15 14:33:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1b6937-145b-452c-a5fb-391973e132d7]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2575730c-e4b9-4841-93d5-5a4cb690a55e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQEJFcTG {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: INFO nova.compute.manager [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 144bf11d-fc91-4bcb-9c63-3e11b3d8661b] Took 0.82 seconds to detach 1 volumes for instance.
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQEJFcTG" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d63bf9-9649-4167-b53d-fcc31a49644a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQEJFcTG'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33513b7-cd5a-47c9-a3ef-011ab2f4d64e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b41a922-71c1-4ed2-87d5-3d7a247ede4f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[16df079f-a02d-4245-90d2-5a96bc89b4db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc, portal: 172.16.0.220,3260]
Nov 15 14:33:50 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc, portal: 172.16.0.220,3260] successful.
Nov 15 14:33:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdpIQkUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:33:50 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[908df535-0de3-46f4-9194-1d0f43d3c87b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[441bcb1c-30da-457b-8346-91ccfe6950c7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:33:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:50 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:33:50 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eae4d5b-7d3b-4468-9a4e-0cfbfa8c0172]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQEJFcTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:50 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Deleted allocations for instance 144bf11d-fc91-4bcb-9c63-3e11b3d8661b
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-781b79f9-2f98-46d0-ab6e-2d5d960c6892 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "144bf11d-fc91-4bcb-9c63-3e11b3d8661b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.579s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '26465613964656237', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465613964656237', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.124s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:33:51 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:33:51 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d532110-942f-408b-a391-97334ebd889c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:33:51 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1890235898',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1890235898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1890235898',id=40,image_ref='5543328b-0f3d-4299-812f-7644ecf69938',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLpunr8uBuUR4o4QbFMGkbe/RjI1Zal/pQ/oqvjTy888eEU9Vrar4qcXyVyAWjy+KaBR2VX34J/MIxllEyAw/g9Zm25Nws98b3HHfYinI4VHYBGJO1ed8kCbxqZcCrSBA==',key_name='tempest-keypair-1887068408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-8gg38qco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1799633332',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c73da782783d41dbb370c3df04dec208',uuid=c7757be7-596d-4e19-a909-362703d903a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f5ad71a-e731-40f9-9895-728ca6306197,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ad71a-e7') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'pci_devices' on Instance uuid c7757be7-596d-4e19-a909-362703d903a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[52899e5a-7594-4b2c-91db-6d391b0f6d22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c] added
Nov 15 14:33:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:33:51 user nova-compute[74892]:   <uuid>c7757be7-596d-4e19-a909-362703d903a6</uuid>
Nov 15 14:33:51 user nova-compute[74892]:   <name>instance-00000028</name>
Nov 15 14:33:51 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:33:51 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:33:51 user nova-compute[74892]:   <metadata>
Nov 15 14:33:51 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:33:51 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:33:51 user nova-compute[74892]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1890235898</nova:name>
Nov 15 14:33:51 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:33:49</nova:creationTime>
Nov 15 14:33:51 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:33:51 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:33:51 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:33:51 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:33:51 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:33:51 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:33:51 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:33:51 user nova-compute[74892]:       <nova:owner>
Nov 15 14:33:51 user nova-compute[74892]:         <nova:user uuid="c73da782783d41dbb370c3df04dec208">tempest-TestVolumeBootPattern-1799633332-project-member</nova:user>
Nov 15 14:33:51 user nova-compute[74892]:         <nova:project uuid="1cdd6323d06f4337995cbb796778b449">tempest-TestVolumeBootPattern-1799633332</nova:project>
Nov 15 14:33:51 user nova-compute[74892]:       </nova:owner>
Nov 15 14:33:51 user nova-compute[74892]:       <nova:root type="image" uuid="5543328b-0f3d-4299-812f-7644ecf69938"/>
Nov 15 14:33:51 user nova-compute[74892]:       <nova:ports>
Nov 15 14:33:51 user nova-compute[74892]:         <nova:port uuid="2f5ad71a-e731-40f9-9895-728ca6306197">
Nov 15 14:33:51 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:33:51 user nova-compute[74892]:         </nova:port>
Nov 15 14:33:51 user nova-compute[74892]:       </nova:ports>
Nov 15 14:33:51 user nova-compute[74892]:     </nova:instance>
Nov 15 14:33:51 user nova-compute[74892]:   </metadata>
Nov 15 14:33:51 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:33:51 user nova-compute[74892]:     <system>
Nov 15 14:33:51 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:33:51 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:33:51 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:33:51 user nova-compute[74892]:       <entry name="serial">c7757be7-596d-4e19-a909-362703d903a6</entry>
Nov 15 14:33:51 user nova-compute[74892]:       <entry name="uuid">c7757be7-596d-4e19-a909-362703d903a6</entry>
Nov 15 14:33:51 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:33:51 user nova-compute[74892]:     </system>
Nov 15 14:33:51 user nova-compute[74892]:   </sysinfo>
Nov 15 14:33:51 user nova-compute[74892]:   <os>
Nov 15 14:33:51 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:33:51 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:33:51 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:33:51 user nova-compute[74892]:   </os>
Nov 15 14:33:51 user nova-compute[74892]:   <features>
Nov 15 14:33:51 user nova-compute[74892]:     <acpi/>
Nov 15 14:33:51 user nova-compute[74892]:     <apic/>
Nov 15 14:33:51 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:33:51 user nova-compute[74892]:   </features>
Nov 15 14:33:51 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:33:51 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:33:51 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:33:51 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:33:51 user nova-compute[74892]:   </clock>
Nov 15 14:33:51 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:33:51 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:33:51 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:33:51 user nova-compute[74892]:   </cpu>
Nov 15 14:33:51 user nova-compute[74892]:   <devices>
Nov 15 14:33:51 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:33:51 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:33:51 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:33:51 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:33:51 user nova-compute[74892]:       <serial>6999e542-84fa-4fc0-9e1c-74b9473604fc</serial>
Nov 15 14:33:51 user nova-compute[74892]:     </disk>
Nov 15 14:33:51 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:33:51 user nova-compute[74892]:       <mac address="fa:16:3e:0e:a0:6b"/>
Nov 15 14:33:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:33:51 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:33:51 user nova-compute[74892]:       <target dev="tap2f5ad71a-e7"/>
Nov 15 14:33:51 user nova-compute[74892]:     </interface>
Nov 15 14:33:51 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:33:51 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/c7757be7-596d-4e19-a909-362703d903a6/console.log" append="off"/>
Nov 15 14:33:51 user nova-compute[74892]:     </serial>
Nov 15 14:33:51 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:33:51 user nova-compute[74892]:     <video>
Nov 15 14:33:51 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:33:51 user nova-compute[74892]:     </video>
Nov 15 14:33:51 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:33:51 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:33:51 user nova-compute[74892]:     </rng>
Nov 15 14:33:51 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:33:51 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:33:51 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:33:51 user nova-compute[74892]:     </memballoon>
Nov 15 14:33:51 user nova-compute[74892]:   </devices>
Nov 15 14:33:51 user nova-compute[74892]: </domain>
Nov 15 14:33:51 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1890235898',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1890235898',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1890235898',id=40,image_ref='5543328b-0f3d-4299-812f-7644ecf69938',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLpunr8uBuUR4o4QbFMGkbe/RjI1Zal/pQ/oqvjTy888eEU9Vrar4qcXyVyAWjy+KaBR2VX34J/MIxllEyAw/g9Zm25Nws98b3HHfYinI4VHYBGJO1ed8kCbxqZcCrSBA==',key_name='tempest-keypair-1887068408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-8gg38qco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1799633332',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:33:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c73da782783d41dbb370c3df04dec208',uuid=c7757be7-596d-4e19-a909-362703d903a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f5ad71a-e731-40f9-9895-728ca6306197,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ad71a-e7') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_vif [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f5ad71a-e731-40f9-9895-728ca6306197,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ad71a-e7') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1483176-f5e7-5852-8c40-d2e254c6ed8b', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efd8439-8093-4051-b6c5-055511934b7b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f5ad71a-e7, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f5ad71a-e7, col_values=(('qos', UUID('2f6b7c54-7000-4266-b06c-36ceed7152f3')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f5ad71a-e7, col_values=(('external_ids', {'iface-id': '2f5ad71a-e731-40f9-9895-728ca6306197', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a0:6b', 'vm-uuid': 'c7757be7-596d-4e19-a909-362703d903a6'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7b9d6b-e8f2-4ecf-beb5-41e2eb0eac3b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:51 user nova-compute[74892]: INFO os_vif [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f5ad71a-e731-40f9-9895-728ca6306197,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ad71a-e7')
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdpIQkUG {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AdpIQkUG" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ba971d-5e91-43cf-9dc1-781646de6529]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AdpIQkUG'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6fdc70-dce9-4a52-9be8-baee2955c8b3]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No VIF found with MAC fa:16:3e:0e:a0:6b, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ce0cef-610b-457d-a1ff-9b7c427bb5e8]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:33:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:33:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[226c2b9a-3bc2-4ba7-9698-0ad158cb9e26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c, portal: 172.16.0.220,3260]
Nov 15 14:33:51 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c, portal: 172.16.0.220,3260] successful.
Nov 15 14:33:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc4b3b8-9898-483c-a4db-19051d33fcf2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d83b1a-1bdf-4d9e-86b2-048855670b34]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:33:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:33:51 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:33:51 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[49542ae8-2d25-415e-892c-109eee895391]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdpIQkUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.780s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== connect_volume: return (4904ms) {'type': 'block', 'scsi_wwn': '23664333138323332', 'path': '/dev/sdf'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664333138323332', 'path': '/dev/sdf'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-a7c1f863-f685-4846-8993-e3c5397198cc req-efa65a3e-f89e-439a-8cef-764a957c4b2a service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7c1f863-f685-4846-8993-e3c5397198cc req-efa65a3e-f89e-439a-8cef-764a957c4b2a service nova] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7c1f863-f685-4846-8993-e3c5397198cc req-efa65a3e-f89e-439a-8cef-764a957c4b2a service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a7c1f863-f685-4846-8993-e3c5397198cc req-efa65a3e-f89e-439a-8cef-764a957c4b2a service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-a7c1f863-f685-4846-8993-e3c5397198cc req-efa65a3e-f89e-439a-8cef-764a957c4b2a service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] No waiting events found dispatching network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:55 user nova-compute[74892]: WARNING nova.compute.manager [req-a7c1f863-f685-4846-8993-e3c5397198cc req-efa65a3e-f89e-439a-8cef-764a957c4b2a service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received unexpected event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 for instance with vm_state building and task_state spawning.
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-d0dba650-60cc-4e05-a9e9-c8b4963cba16 req-704687a0-5d07-4d8d-9b98-b1bfd1b4690d service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0dba650-60cc-4e05-a9e9-c8b4963cba16 req-704687a0-5d07-4d8d-9b98-b1bfd1b4690d service nova] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0dba650-60cc-4e05-a9e9-c8b4963cba16 req-704687a0-5d07-4d8d-9b98-b1bfd1b4690d service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0dba650-60cc-4e05-a9e9-c8b4963cba16 req-704687a0-5d07-4d8d-9b98-b1bfd1b4690d service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-d0dba650-60cc-4e05-a9e9-c8b4963cba16 req-704687a0-5d07-4d8d-9b98-b1bfd1b4690d service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] No waiting events found dispatching network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:33:55 user nova-compute[74892]: WARNING nova.compute.manager [req-d0dba650-60cc-4e05-a9e9-c8b4963cba16 req-704687a0-5d07-4d8d-9b98-b1bfd1b4690d service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received unexpected event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 for instance with vm_state building and task_state spawning.
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:33:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:33:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=24.88491439819336GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:33:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c7757be7-596d-4e19-a909-362703d903a6] Instance spawned successfully.
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:33:55 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:33:55 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:33:55 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:33:55 user nova-compute[74892]:   <serial>759e963b-ce56-4288-800f-16bc91000f9c</serial>
Nov 15 14:33:55 user nova-compute[74892]: </disk>
Nov 15 14:33:55 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:33:55 user nova-compute[74892]: INFO nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Took 5.45 seconds to spawn the instance on the hypervisor.
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a80d8849-d199-4b95-9c3b-d673bd0ded3c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1b456afe-f03e-4856-aa42-634959e5547d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 728aaeb0-c063-49da-8046-575c82f5fe4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance daeb5cce-969d-4671-872d-4c68f593d0da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c7757be7-596d-4e19-a909-362703d903a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:33:55 user nova-compute[74892]: INFO nova.compute.manager [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Took 18.43 seconds to build instance.
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d38aacea-b3c2-40ce-a5b3-ae4f91bcc6a9 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c7757be7-596d-4e19-a909-362703d903a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.601s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "c7757be7-596d-4e19-a909-362703d903a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.482s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:55 user nova-compute[74892]: INFO nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: c7757be7-596d-4e19-a909-362703d903a6] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "c7757be7-596d-4e19-a909-362703d903a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No VIF found with MAC fa:16:3e:1e:4f:98, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-94db5882-b971-4806-bc55-6b035f760dbd tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.752s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:55 user nova-compute[74892]: INFO nova.compute.manager [None req-25746a99-6ab8-4ed6-810e-a331797412c7 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Get console output
Nov 15 14:33:56 user nova-compute[74892]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 14:33:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:33:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:57 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:33:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:33:58 user nova-compute[74892]: INFO nova.compute.manager [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Attaching volume b83f0b26-4d67-4c50-acc8-cad4adcf05b0 to /dev/vdc
Nov 15 14:33:58 user nova-compute[74892]: DEBUG os_brick.utils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5a4ca-8b64-4a4e-913f-efeac161574d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b81fa6-27ff-4dfd-b877-4d0e4b0374f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc35437-956b-47c5-b627-b406e6a6f814]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b7f0cb-f4c6-4005-aa45-82ba33758347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:33:58 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de465f0-b05c-4aeb-8302-ecf26f690f64]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG os_brick.utils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Updating existing volume attachment record: 9d99b08d-8070-48ed-9e90-5fc94fdbcf0b {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:33:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updating instance_info_cache with network_info: [{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:33:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:34:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-961b69f7-a74f-4d3c-a9bb-6c9b02d359c4 req-2999204f-7ade-49e3-818c-cdacb5c41511 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received event network-changed-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-961b69f7-a74f-4d3c-a9bb-6c9b02d359c4 req-2999204f-7ade-49e3-818c-cdacb5c41511 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Refreshing instance network info cache due to event network-changed-8066b09b-2f4a-4365-ad3f-1d3d2650222c. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:34:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-961b69f7-a74f-4d3c-a9bb-6c9b02d359c4 req-2999204f-7ade-49e3-818c-cdacb5c41511 service nova] Acquiring lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:34:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-961b69f7-a74f-4d3c-a9bb-6c9b02d359c4 req-2999204f-7ade-49e3-818c-cdacb5c41511 service nova] Acquired lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:34:02 user nova-compute[74892]: DEBUG nova.network.neutron [req-961b69f7-a74f-4d3c-a9bb-6c9b02d359c4 req-2999204f-7ade-49e3-818c-cdacb5c41511 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Refreshing network info cache for port 8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:34:02 user nova-compute[74892]: DEBUG nova.network.neutron [req-961b69f7-a74f-4d3c-a9bb-6c9b02d359c4 req-2999204f-7ade-49e3-818c-cdacb5c41511 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Updated VIF entry in instance network info cache for port 8066b09b-2f4a-4365-ad3f-1d3d2650222c. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:34:02 user nova-compute[74892]: DEBUG nova.network.neutron [req-961b69f7-a74f-4d3c-a9bb-6c9b02d359c4 req-2999204f-7ade-49e3-818c-cdacb5c41511 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Updating instance_info_cache with network_info: [{"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:34:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-961b69f7-a74f-4d3c-a9bb-6c9b02d359c4 req-2999204f-7ade-49e3-818c-cdacb5c41511 service nova] Releasing lock "refresh_cache-daeb5cce-969d-4671-872d-4c68f593d0da" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgAKlBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:34:03 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:34:03 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:34:03 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02cc919-2d31-405b-ad9b-f5971c94069a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:34:03 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f13b5d-e5ab-4ac8-a418-ebd5fcfd88e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0] added
Nov 15 14:34:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc2391e-4ef8-46b8-be0f-f7952ac328c1]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bcf830-04d4-41a6-9b10-2501fc11d8fb]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgAKlBFC {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgAKlBFC" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddfb8c8-f185-4e3a-a031-c84499660ae3]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgAKlBFC'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7b06f5-bbaf-4ab6-b729-38305a349355]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[72495396-1652-4d8c-abac-8660a70fdc1a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e55665a-d653-4464-8d74-f2587a77f9f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0, portal: 172.16.0.220,3260]
Nov 15 14:34:03 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0, portal: 172.16.0.220,3260] successful.
Nov 15 14:34:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3651091f-a967-4708-803b-575f2a473a8e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5b9d37-a14d-4d8e-9168-548adc35b3e7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:03 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] HCTL ('38', '-', '-', 0) found on session 45 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0581f742-7d64-4932-8f76-a696fea77560]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Searching for a device in session 45 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:34:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgAKlBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26264343363633931', 'path': '/dev/sdg'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264343363633931', 'path': '/dev/sdg'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:34:04 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:34:04 user nova-compute[74892]:   <source dev="/dev/sdg"/>
Nov 15 14:34:04 user nova-compute[74892]:   <target dev="vdc" bus="virtio"/>
Nov 15 14:34:04 user nova-compute[74892]:   <serial>b83f0b26-4d67-4c50-acc8-cad4adcf05b0</serial>
Nov 15 14:34:04 user nova-compute[74892]: </disk>
Nov 15 14:34:04 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG nova.objects.instance [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid daeb5cce-969d-4671-872d-4c68f593d0da {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:04 user nova-compute[74892]: INFO nova.compute.manager [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Attaching volume 6ec4d35c-a1bd-46fc-885e-77046dab5612 to /dev/vdb
Nov 15 14:34:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:34:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] No VIF found with MAC fa:16:3e:1e:4f:98, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG os_brick.utils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[088ecf10-ebba-47d0-9733-ed1f234fec2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe55ac4-d950-4fb4-9eb9-170790c43854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3782fbc-2846-40ae-be9c-6d121589685e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3fa012-e11d-4199-82f3-ff7e5db71547]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:34:05 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e971f97d-b8ba-4600-96db-55ad942390e1]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ed045d81-c40b-47a5-b833-c000acd0f8c8 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.095s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG os_brick.utils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:34:05 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Updating existing volume attachment record: 49f0486b-5f87-4556-8cbd-3d73e5623dcc {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:34:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:06 user nova-compute[74892]: INFO nova.compute.manager [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Detaching volume 759e963b-ce56-4288-800f-16bc91000f9c
Nov 15 14:34:06 user nova-compute[74892]: INFO nova.virt.block_device [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Attempting to driver detach volume 759e963b-ce56-4288-800f-16bc91000f9c from mountpoint /dev/vdb
Nov 15 14:34:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Attempting to detach device vdb from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:34:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:34:06 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:34:06 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:34:06 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:34:06 user nova-compute[74892]:   <serial>759e963b-ce56-4288-800f-16bc91000f9c</serial>
Nov 15 14:34:06 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:34:06 user nova-compute[74892]: </disk>
Nov 15 14:34:06 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:34:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully detached device vdb from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 from the persistent domain config.
Nov 15 14:34:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:34:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:34:06 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:34:06 user nova-compute[74892]:   <source dev="/dev/sdf"/>
Nov 15 14:34:06 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:34:06 user nova-compute[74892]:   <serial>759e963b-ce56-4288-800f-16bc91000f9c</serial>
Nov 15 14:34:06 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:34:06 user nova-compute[74892]: </disk>
Nov 15 14:34:06 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:34:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:34:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:34:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdwqXNup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:34:09 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:34:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:34:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:34:09 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:34:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:34:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:34:09 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:34:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[46895cb2-8599-49e9-b1bd-21b383a198bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:34:09 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e35544-ed14-4859-b506-e640b3948e66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612] added
Nov 15 14:34:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c265217-c52f-4a74-a12d-3c0753b9c126]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e221994-ebaa-41a9-9bb7-32b2669d4dbc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdwqXNup {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdwqXNup" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[708f0f29-a53c-4497-a2c7-4d31f14e256c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdwqXNup'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdbfc2a-f5be-40da-a2f9-e18f20174d80]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1eac3fe-6d36-4814-ac25-2433222bd6f9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c25ca5-c3a8-4110-a735-d15459e67cfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612, portal: 172.16.0.220,3260]
Nov 15 14:34:10 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612, portal: 172.16.0.220,3260] successful.
Nov 15 14:34:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3000c2d6-53c3-4a0e-b7a8-727888fa0609]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0e4f8-1be5-4a02-8944-4d8baf3c6b71]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)
Nov 15 14:34:10 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] HCTL ('39', '-', '-', 0) found on session 46 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9ccda9-1bdf-4ba0-a708-5cc01f7efd2a]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Searching for a device in session 46 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:34:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdwqXNup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26233326431336437', 'path': '/dev/sdh'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233326431336437', 'path': '/dev/sdh'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG nova.objects.instance [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid daeb5cce-969d-4671-872d-4c68f593d0da {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:34:11 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:34:11 user nova-compute[74892]:   <source dev="/dev/sdh"/>
Nov 15 14:34:11 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:34:11 user nova-compute[74892]:   <serial>6ec4d35c-a1bd-46fc-885e-77046dab5612</serial>
Nov 15 14:34:11 user nova-compute[74892]: </disk>
Nov 15 14:34:11 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] No VIF found with MAC fa:16:3e:e5:56:fb, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-75908174-3d9b-40d0-a9f3-bb76066f0042 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.894s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:12 user nova-compute[74892]: INFO nova.compute.manager [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Detaching volume 6ec4d35c-a1bd-46fc-885e-77046dab5612
Nov 15 14:34:12 user nova-compute[74892]: INFO nova.virt.block_device [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Attempting to driver detach volume 6ec4d35c-a1bd-46fc-885e-77046dab5612 from mountpoint /dev/vdb
Nov 15 14:34:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Attempting to detach device vdb from instance daeb5cce-969d-4671-872d-4c68f593d0da from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:34:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:34:12 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:34:12 user nova-compute[74892]:   <source dev="/dev/sdh"/>
Nov 15 14:34:12 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:34:12 user nova-compute[74892]:   <serial>6ec4d35c-a1bd-46fc-885e-77046dab5612</serial>
Nov 15 14:34:12 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:34:12 user nova-compute[74892]: </disk>
Nov 15 14:34:12 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:34:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully detached device vdb from instance daeb5cce-969d-4671-872d-4c68f593d0da from the persistent domain config.
Nov 15 14:34:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance daeb5cce-969d-4671-872d-4c68f593d0da from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:34:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:34:12 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:34:12 user nova-compute[74892]:   <source dev="/dev/sdh"/>
Nov 15 14:34:12 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:34:12 user nova-compute[74892]:   <serial>6ec4d35c-a1bd-46fc-885e-77046dab5612</serial>
Nov 15 14:34:12 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:34:12 user nova-compute[74892]: </disk>
Nov 15 14:34:12 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:34:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance daeb5cce-969d-4671-872d-4c68f593d0da {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:34:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:26 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 is timed out.
Nov 15 14:34:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully detached device vdb from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 from the live domain config.
Nov 15 14:34:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AdpIQkUG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:34:26 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23cc2f9-775e-42c3-aa99-eaf8b1882112]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:34:26 user nova-compute[74892]: No targets found.
Nov 15 14:34:26 user nova-compute[74892]: iSNS:
Nov 15 14:34:26 user nova-compute[74892]: No targets found.
Nov 15 14:34:26 user nova-compute[74892]: STATIC:
Nov 15 14:34:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0
Nov 15 14:34:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c
Nov 15 14:34:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612
Nov 15 14:34:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc
Nov 15 14:34:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74
Nov 15 14:34:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:34:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:26 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:34:26 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:26 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:26 user nova-compute[74892]: FIRMWARE:
Nov 15 14:34:26 user nova-compute[74892]: No targets found.
Nov 15 14:34:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:34:26 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:34:26 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ddef40-ddd2-423b-8a62-0128bacad87f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[73100062-e561-4186-96ec-f2ec29e0d909]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)
Nov 15 14:34:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:26 user nova-compute[74892]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)
Nov 15 14:34:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2016c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c'): ({'sdf'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Removing single pathed devices sdf {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad15eee2-bbfe-42f3-9abf-a5a8e90fbb65]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f372ca-05b6-470b-b958-219f0f58bb83]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flushing IO for device /dev/sdf {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3d2614-0af3-4649-974f-b62582d006c3]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9fa1ad-a0a5-423b-bdb6-2998940c502e]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] SCSI volumes sdf have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f2e6ed-18b0-439f-9942-435758d1236f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecbdd2d-4cb8-4c69-ba72-16ca2440193e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c, portal: 172.16.0.220,3260]
Nov 15 14:34:26 user nova-compute[74892]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c, portal: 172.16.0.220,3260] successful.
Nov 15 14:34:26 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:759e963b-ce56-4288-800f-16bc91000f9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a48e335-bb2d-44e0-ae4c-32e05bfe948a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:34:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== disconnect_volume: return (313ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:34:27 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:34:27 user nova-compute[74892]: DEBUG nova.objects.instance [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5e4c96e7-3335-40f1-b08a-f98393acae7f tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:28 user nova-compute[74892]: INFO nova.compute.manager [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Detaching volume b83f0b26-4d67-4c50-acc8-cad4adcf05b0
Nov 15 14:34:28 user nova-compute[74892]: INFO nova.virt.block_device [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Attempting to driver detach volume b83f0b26-4d67-4c50-acc8-cad4adcf05b0 from mountpoint /dev/vdc
Nov 15 14:34:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Attempting to detach device vdc from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:34:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:34:28 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:34:28 user nova-compute[74892]:   <source dev="/dev/sdg"/>
Nov 15 14:34:28 user nova-compute[74892]:   <target dev="vdc" bus="virtio"/>
Nov 15 14:34:28 user nova-compute[74892]:   <serial>b83f0b26-4d67-4c50-acc8-cad4adcf05b0</serial>
Nov 15 14:34:28 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 14:34:28 user nova-compute[74892]: </disk>
Nov 15 14:34:28 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:34:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully detached device vdc from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 from the persistent domain config.
Nov 15 14:34:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:34:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:34:28 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:34:28 user nova-compute[74892]:   <source dev="/dev/sdg"/>
Nov 15 14:34:28 user nova-compute[74892]:   <target dev="vdc" bus="virtio"/>
Nov 15 14:34:28 user nova-compute[74892]:   <serial>b83f0b26-4d67-4c50-acc8-cad4adcf05b0</serial>
Nov 15 14:34:28 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 14:34:28 user nova-compute[74892]: </disk>
Nov 15 14:34:28 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:34:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:34:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance daeb5cce-969d-4671-872d-4c68f593d0da is timed out.
Nov 15 14:34:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully detached device vdb from instance daeb5cce-969d-4671-872d-4c68f593d0da from the live domain config.
Nov 15 14:34:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdwqXNup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:34:33 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2c9715-9cc2-4c07-9d6b-ebdb3d0abc41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:34:33 user nova-compute[74892]: No targets found.
Nov 15 14:34:33 user nova-compute[74892]: iSNS:
Nov 15 14:34:33 user nova-compute[74892]: No targets found.
Nov 15 14:34:33 user nova-compute[74892]: STATIC:
Nov 15 14:34:33 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0
Nov 15 14:34:33 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:33 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:33 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612
Nov 15 14:34:33 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:33 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:33 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc
Nov 15 14:34:33 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:33 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:33 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74
Nov 15 14:34:33 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:33 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:33 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:34:33 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:33 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:33 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:34:33 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:33 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:33 user nova-compute[74892]: FIRMWARE:
Nov 15 14:34:33 user nova-compute[74892]: No targets found.
Nov 15 14:34:33 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:34:33 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:34:33 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5502655b-1b7a-4fb4-a76d-6e5fdec8ceb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f1f897-3cc9-493f-9da3-31b1513ac297]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)
Nov 15 14:34:33 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:33 user nova-compute[74892]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 (non-flash)
Nov 15 14:34:33 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd4985c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612'): ({'sdh'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Removing single pathed devices sdh {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b1e69-ab9a-4ac7-879f-1afdc3eb904f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e5438c-8e02-4744-9f51-23269eb462b9]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Flushing IO for device /dev/sdh {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e98659b-f29f-439e-8672-924b530e1f1a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c27d034-2f54-4fc0-bc1f-e5a84093b3f8]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] SCSI volumes sdh have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[975efb7b-bd94-41a2-93c6-ac2579b2f4df]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8aefef-2a14-4dff-a19f-c752c5ecda6e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612, portal: 172.16.0.220,3260]
Nov 15 14:34:33 user nova-compute[74892]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612, portal: 172.16.0.220,3260] successful.
Nov 15 14:34:33 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6ec4d35c-a1bd-46fc-885e-77046dab5612 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62b9522-83c3-4fb3-beb5-42cb6ef602ff]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] <== disconnect_volume: return (347ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:34:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:34:34 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'flavor' on Instance uuid daeb5cce-969d-4671-872d-4c68f593d0da {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1945982b-418c-4573-a3a1-21796584dd95 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.853s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:34:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:38 user nova-compute[74892]: INFO nova.compute.manager [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Terminating instance
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.compute.manager [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-0705b3f1-cdf3-4f4f-8603-ac5635269309 req-a462b7c8-5ff9-403e-aead-ff8ad645747d service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received event network-vif-unplugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0705b3f1-cdf3-4f4f-8603-ac5635269309 req-a462b7c8-5ff9-403e-aead-ff8ad645747d service nova] Acquiring lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0705b3f1-cdf3-4f4f-8603-ac5635269309 req-a462b7c8-5ff9-403e-aead-ff8ad645747d service nova] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-0705b3f1-cdf3-4f4f-8603-ac5635269309 req-a462b7c8-5ff9-403e-aead-ff8ad645747d service nova] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-0705b3f1-cdf3-4f4f-8603-ac5635269309 req-a462b7c8-5ff9-403e-aead-ff8ad645747d service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] No waiting events found dispatching network-vif-unplugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-0705b3f1-cdf3-4f4f-8603-ac5635269309 req-a462b7c8-5ff9-403e-aead-ff8ad645747d service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received event network-vif-unplugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Instance destroyed successfully.
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.objects.instance [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'resources' on Instance uuid a80d8849-d199-4b95-9c3b-d673bd0ded3c {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:25:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-310410644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-310410644',id=28,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:25:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-if38prr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:27:12Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=a80d8849-d199-4b95-9c3b-d673bd0ded3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "address": "fa:16:3e:a9:e5:f3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa052c7fb-fc", "ovs_interfaceid": "a052c7fb-fc4c-4f52-81a6-9e4117355906", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e5:f3,bridge_name='br-int',has_traffic_filtering=True,id=a052c7fb-fc4c-4f52-81a6-9e4117355906,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa052c7fb-fc') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG os_vif [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e5:f3,bridge_name='br-int',has_traffic_filtering=True,id=a052c7fb-fc4c-4f52-81a6-9e4117355906,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa052c7fb-fc') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa052c7fb-fc, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0cbf5af-52a2-4459-a6d3-3981cc6e1f0b) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:34:38 user nova-compute[74892]: INFO os_vif [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:e5:f3,bridge_name='br-int',has_traffic_filtering=True,id=a052c7fb-fc4c-4f52-81a6-9e4117355906,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa052c7fb-fc')
Nov 15 14:34:38 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Deleting instance files /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c_del
Nov 15 14:34:38 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Deletion of /opt/stack/data/nova/instances/a80d8849-d199-4b95-9c3b-d673bd0ded3c_del complete
Nov 15 14:34:38 user nova-compute[74892]: INFO nova.compute.manager [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 14:34:38 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:34:38 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:34:39 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:34:39 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Took 0.44 seconds to deallocate network for instance.
Nov 15 14:34:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:39 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:34:39 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:34:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:39 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Deleted allocations for instance a80d8849-d199-4b95-9c3b-d673bd0ded3c
Nov 15 14:34:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-5920fa0f-2a34-4078-b2e0-a84b108b4639 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.649s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-eaa2b1c5-6b2f-4780-b90d-fde06c00620d req-3e0ee22f-e5ea-475a-9ac8-62c0ad8f13a2 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received event network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eaa2b1c5-6b2f-4780-b90d-fde06c00620d req-3e0ee22f-e5ea-475a-9ac8-62c0ad8f13a2 service nova] Acquiring lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eaa2b1c5-6b2f-4780-b90d-fde06c00620d req-3e0ee22f-e5ea-475a-9ac8-62c0ad8f13a2 service nova] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-eaa2b1c5-6b2f-4780-b90d-fde06c00620d req-3e0ee22f-e5ea-475a-9ac8-62c0ad8f13a2 service nova] Lock "a80d8849-d199-4b95-9c3b-d673bd0ded3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-eaa2b1c5-6b2f-4780-b90d-fde06c00620d req-3e0ee22f-e5ea-475a-9ac8-62c0ad8f13a2 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] No waiting events found dispatching network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:34:40 user nova-compute[74892]: WARNING nova.compute.manager [req-eaa2b1c5-6b2f-4780-b90d-fde06c00620d req-3e0ee22f-e5ea-475a-9ac8-62c0ad8f13a2 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received unexpected event network-vif-plugged-a052c7fb-fc4c-4f52-81a6-9e4117355906 for instance with vm_state deleted and task_state None.
Nov 15 14:34:40 user nova-compute[74892]: DEBUG nova.compute.manager [req-eaa2b1c5-6b2f-4780-b90d-fde06c00620d req-3e0ee22f-e5ea-475a-9ac8-62c0ad8f13a2 service nova] [instance: a80d8849-d199-4b95-9c3b-d673bd0ded3c] Received event network-vif-deleted-a052c7fb-fc4c-4f52-81a6-9e4117355906 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:34:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 is timed out.
Nov 15 14:34:49 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully detached device vdc from instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1 from the live domain config.
Nov 15 14:34:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgAKlBFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:34:49 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f19a80-8ff2-4bf2-9879-331cb9e9f6d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:34:49 user nova-compute[74892]: No targets found.
Nov 15 14:34:49 user nova-compute[74892]: iSNS:
Nov 15 14:34:49 user nova-compute[74892]: No targets found.
Nov 15 14:34:49 user nova-compute[74892]: STATIC:
Nov 15 14:34:49 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0
Nov 15 14:34:49 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:49 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:49 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc
Nov 15 14:34:49 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:49 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:49 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74
Nov 15 14:34:49 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:49 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:49 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:34:49 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:49 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:49 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:34:49 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:49 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:49 user nova-compute[74892]: FIRMWARE:
Nov 15 14:34:49 user nova-compute[74892]: No targets found.
Nov 15 14:34:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:34:49 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:34:49 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d608d4-92f6-45df-ac3c-42f49fbec447]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[538c3517-06b5-4d7a-9fd5-0bc201cb533a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:49 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:49 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:49 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:49 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:49 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:49 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:49 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:49 user nova-compute[74892]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 (non-flash)
Nov 15 14:34:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2057e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0'): ({'sdg'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Removing single pathed devices sdg {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29880f2-4a24-4e3f-8c9d-2594bbfadf7c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3aefdb-167e-4d15-9b3f-93ee0c206031]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Flushing IO for device /dev/sdg {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c490f3-715e-4179-998c-8a07c432a2ca]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[57745f11-770d-4b91-aef1-ea98faee33c2]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] SCSI volumes sdg have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b547aa4-9bbd-452e-aaa1-1b0517356c9a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dc35dc-5fe7-4122-ad8b-33d59b60dc8b]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0, portal: 172.16.0.220,3260]
Nov 15 14:34:49 user nova-compute[74892]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0, portal: 172.16.0.220,3260] successful.
Nov 15 14:34:49 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b83f0b26-4d67-4c50-acc8-cad4adcf05b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b2539a-eddb-4264-8eed-92eb92c7d8e2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] <== disconnect_volume: return (317ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:34:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'flavor' on Instance uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c12f00ff-c43a-4b91-a8b4-2d52f2fed6c9 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:34:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:51 user nova-compute[74892]: INFO nova.compute.manager [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Terminating instance
Nov 15 14:34:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-9ceec059-d0d1-4dc6-92f0-f4666cecfa3d req-1f4f364f-3acb-434e-9174-bb4a01aa4776 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received event network-vif-unplugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9ceec059-d0d1-4dc6-92f0-f4666cecfa3d req-1f4f364f-3acb-434e-9174-bb4a01aa4776 service nova] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9ceec059-d0d1-4dc6-92f0-f4666cecfa3d req-1f4f364f-3acb-434e-9174-bb4a01aa4776 service nova] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9ceec059-d0d1-4dc6-92f0-f4666cecfa3d req-1f4f364f-3acb-434e-9174-bb4a01aa4776 service nova] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-9ceec059-d0d1-4dc6-92f0-f4666cecfa3d req-1f4f364f-3acb-434e-9174-bb4a01aa4776 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] No waiting events found dispatching network-vif-unplugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:34:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-9ceec059-d0d1-4dc6-92f0-f4666cecfa3d req-1f4f364f-3acb-434e-9174-bb4a01aa4776 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received event network-vif-unplugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Instance destroyed successfully.
Nov 15 14:34:52 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lazy-loading 'resources' on Instance uuid 6dbf4049-8734-4d46-b3c8-823444a4fdf1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:31:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-158365474',display_name='tempest-AttachVolumeTestJSON-server-158365474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-158365474',id=38,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK55Bow/G8Om8ULZE6a6g5aOuJmUfeurm3zMW6q8qiKqzUQXClDB1x60HQbB5X09xqGBfWGVZ7DRoryUyaQ2T/AaCmVEWcfZPLrntMUCvRu90YHInqbVvxdA9SqxYnsn3w==',key_name='tempest-keypair-172152670',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5649287d611341a7850ed74e51b7bfe3',ramdisk_id='',reservation_id='r-sc626akd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1499270628',owner_user_name='tempest-AttachVolumeTestJSON-1499270628-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1a85e0d65c2248e0aca031055b162e86',uuid=6dbf4049-8734-4d46-b3c8-823444a4fdf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converting VIF {"id": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "address": "fa:16:3e:1e:4f:98", "network": {"id": "881283e9-6075-47bd-92b0-1a9249a645e6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-605568184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5649287d611341a7850ed74e51b7bfe3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb866e1d3-3f", "ovs_interfaceid": "b866e1d3-3fb0-4d4b-8a42-4a6943852329", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=b866e1d3-3fb0-4d4b-8a42-4a6943852329,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb866e1d3-3f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG os_vif [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=b866e1d3-3fb0-4d4b-8a42-4a6943852329,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb866e1d3-3f') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb866e1d3-3f, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28ebf784-feba-43f2-a245-02b1408237e0) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:52 user nova-compute[74892]: INFO os_vif [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=b866e1d3-3fb0-4d4b-8a42-4a6943852329,network=Network(881283e9-6075-47bd-92b0-1a9249a645e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb866e1d3-3f')
Nov 15 14:34:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Deleting instance files /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1_del
Nov 15 14:34:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Deletion of /opt/stack/data/nova/instances/6dbf4049-8734-4d46-b3c8-823444a4fdf1_del complete
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:52 user nova-compute[74892]: INFO nova.compute.manager [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:34:53 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Took 0.84 seconds to deallocate network for instance.
Nov 15 14:34:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:53 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:34:53 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:34:53 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=25.00711441040039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-8cf82b09-a2d5-4720-aa03-b705601f81e1 req-79780afd-c796-4a43-bc18-4d01cac2dbc5 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received event network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8cf82b09-a2d5-4720-aa03-b705601f81e1 req-79780afd-c796-4a43-bc18-4d01cac2dbc5 service nova] Acquiring lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8cf82b09-a2d5-4720-aa03-b705601f81e1 req-79780afd-c796-4a43-bc18-4d01cac2dbc5 service nova] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8cf82b09-a2d5-4720-aa03-b705601f81e1 req-79780afd-c796-4a43-bc18-4d01cac2dbc5 service nova] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-8cf82b09-a2d5-4720-aa03-b705601f81e1 req-79780afd-c796-4a43-bc18-4d01cac2dbc5 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] No waiting events found dispatching network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:34:54 user nova-compute[74892]: WARNING nova.compute.manager [req-8cf82b09-a2d5-4720-aa03-b705601f81e1 req-79780afd-c796-4a43-bc18-4d01cac2dbc5 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received unexpected event network-vif-plugged-b866e1d3-3fb0-4d4b-8a42-4a6943852329 for instance with vm_state deleted and task_state None.
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-8cf82b09-a2d5-4720-aa03-b705601f81e1 req-79780afd-c796-4a43-bc18-4d01cac2dbc5 service nova] [instance: 6dbf4049-8734-4d46-b3c8-823444a4fdf1] Received event network-vif-deleted-b866e1d3-3fb0-4d4b-8a42-4a6943852329 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.356s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:54 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Deleted allocations for instance 6dbf4049-8734-4d46-b3c8-823444a4fdf1
Nov 15 14:34:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4a98aa84-4ba8-4898-ab0e-99adae1d7087 tempest-AttachVolumeTestJSON-1499270628 tempest-AttachVolumeTestJSON-1499270628-project-member] Lock "6dbf4049-8734-4d46-b3c8-823444a4fdf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.644s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 1b456afe-f03e-4856-aa42-634959e5547d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 728aaeb0-c063-49da-8046-575c82f5fe4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance daeb5cce-969d-4671-872d-4c68f593d0da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c7757be7-596d-4e19-a909-362703d903a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:34:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:55 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:34:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:34:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:34:55 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updating instance_info_cache with network_info: [{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:56 user nova-compute[74892]: INFO nova.compute.manager [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Terminating instance
Nov 15 14:34:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-71f8df6a-25f4-4791-a10b-4780fb661440 req-5a9137b6-3526-4304-9517-31f6c738f044 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-unplugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-71f8df6a-25f4-4791-a10b-4780fb661440 req-5a9137b6-3526-4304-9517-31f6c738f044 service nova] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-71f8df6a-25f4-4791-a10b-4780fb661440 req-5a9137b6-3526-4304-9517-31f6c738f044 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-71f8df6a-25f4-4791-a10b-4780fb661440 req-5a9137b6-3526-4304-9517-31f6c738f044 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-71f8df6a-25f4-4791-a10b-4780fb661440 req-5a9137b6-3526-4304-9517-31f6c738f044 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] No waiting events found dispatching network-vif-unplugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-71f8df6a-25f4-4791-a10b-4780fb661440 req-5a9137b6-3526-4304-9517-31f6c738f044 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-unplugged-90e29962-319e-43d8-b270-26d1859d0d36 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:34:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Instance destroyed successfully.
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.objects.instance [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'resources' on Instance uuid 1b456afe-f03e-4856-aa42-634959e5547d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:28:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836258062',display_name='tempest-ServerActionsTestOtherA-server-1836258062',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836258062',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:30:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-tgmqdx1p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=1b456afe-f03e-4856-aa42-634959e5547d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "90e29962-319e-43d8-b270-26d1859d0d36", "address": "fa:16:3e:81:3e:de", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90e29962-31", "ovs_interfaceid": "90e29962-319e-43d8-b270-26d1859d0d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_vif [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90e29962-31, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cdd3f85-6410-41b4-9563-63b4e0ad9cd0) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:34:57 user nova-compute[74892]: INFO os_vif [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:3e:de,bridge_name='br-int',has_traffic_filtering=True,id=90e29962-319e-43d8-b270-26d1859d0d36,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90e29962-31')
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQyDsgUR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:34:57 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97cf10c-dfef-4a05-97c7-2c250476419d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:34:57 user nova-compute[74892]: No targets found.
Nov 15 14:34:57 user nova-compute[74892]: iSNS:
Nov 15 14:34:57 user nova-compute[74892]: No targets found.
Nov 15 14:34:57 user nova-compute[74892]: STATIC:
Nov 15 14:34:57 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc
Nov 15 14:34:57 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:57 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:57 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74
Nov 15 14:34:57 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:57 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:57 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:34:57 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:57 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:57 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f
Nov 15 14:34:57 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:34:57 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:34:57 user nova-compute[74892]: FIRMWARE:
Nov 15 14:34:57 user nova-compute[74892]: No targets found.
Nov 15 14:34:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:34:57 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:34:57 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad5a4d0-3a3b-4626-9960-e1a9be47489d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4334a4-7ccf-4c8d-ae1f-45c3b7bf0a79]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:57 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:57 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:57 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:34:57 user nova-compute[74892]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f (non-flash)
Nov 15 14:34:57 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:34:57 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:34:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20703520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f'): ({'sde'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Removing single pathed devices sde {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a09adeb-181f-49b0-9abe-dc0bd4381323]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb410fa2-d2c4-489f-848f-11cb67ffcd57]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Flushing IO for device /dev/sde {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[baea871f-3fac-4480-9565-48a706593328]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b292ef-16df-4792-869e-abdc75ce7551]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] SCSI volumes sde have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2c748622-8ef7e2a3528ae150', '/dev/disk/by-id/scsi-23865663765326133', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2c748622') {{(pid=85038) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 14:34:57 user nova-compute[74892]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2c748622-8ef7e2a3528ae150
Nov 15 14:34:57 user nova-compute[74892]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23865663765326133
Nov 15 14:34:57 user nova-compute[74892]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2c748622
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a4b19-98c5-4b7c-901c-20505ec5c8a7]: (4, None) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f47f613-8da5-42f3-9a09-af76b85ebf81]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8441f-a934-45dc-b6f9-f6b6a1a66173]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260]
Nov 15 14:34:57 user nova-compute[74892]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f, portal: 172.16.0.220,3260] successful.
Nov 15 14:34:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7463944-aa87-4fae-9e85-4ec46ba5038f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb994f64-b53d-44e7-969c-418e3138d753]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] <== disconnect_volume: return (304ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:34:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Deleting instance files /opt/stack/data/nova/instances/1b456afe-f03e-4856-aa42-634959e5547d_del
Nov 15 14:34:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Deletion of /opt/stack/data/nova/instances/1b456afe-f03e-4856-aa42-634959e5547d_del complete
Nov 15 14:34:57 user nova-compute[74892]: INFO nova.compute.manager [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 14:34:57 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:34:57 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:34:58 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:34:58 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Took 0.76 seconds to deallocate network for instance.
Nov 15 14:34:58 user nova-compute[74892]: DEBUG nova.compute.manager [req-3ea28445-b525-45e5-8c71-e50abd5d9c8a req-54314d8b-a329-4d16-ad4e-88b6740414fe service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-deleted-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-ab6cc26f-5172-48b8-a2e1-1c3efd820a8b req-6179dd00-3abb-4121-89ff-879d0d9ffe40 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab6cc26f-5172-48b8-a2e1-1c3efd820a8b req-6179dd00-3abb-4121-89ff-879d0d9ffe40 service nova] Acquiring lock "1b456afe-f03e-4856-aa42-634959e5547d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab6cc26f-5172-48b8-a2e1-1c3efd820a8b req-6179dd00-3abb-4121-89ff-879d0d9ffe40 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ab6cc26f-5172-48b8-a2e1-1c3efd820a8b req-6179dd00-3abb-4121-89ff-879d0d9ffe40 service nova] Lock "1b456afe-f03e-4856-aa42-634959e5547d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-ab6cc26f-5172-48b8-a2e1-1c3efd820a8b req-6179dd00-3abb-4121-89ff-879d0d9ffe40 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] No waiting events found dispatching network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:34:59 user nova-compute[74892]: WARNING nova.compute.manager [req-ab6cc26f-5172-48b8-a2e1-1c3efd820a8b req-6179dd00-3abb-4121-89ff-879d0d9ffe40 service nova] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Received unexpected event network-vif-plugged-90e29962-319e-43d8-b270-26d1859d0d36 for instance with vm_state active and task_state deleting.
Nov 15 14:34:59 user nova-compute[74892]: INFO nova.compute.manager [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 14:34:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 1b456afe-f03e-4856-aa42-634959e5547d] Deleting volume: f7463944-aa87-4fae-9e85-4ec46ba5038f {{(pid=74892) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:34:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:34:59 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Deleted allocations for instance 1b456afe-f03e-4856-aa42-634959e5547d
Nov 15 14:34:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-745ba616-f75d-4ff4-8b95-29ecfc70c34e tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "1b456afe-f03e-4856-aa42-634959e5547d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.238s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:03 user nova-compute[74892]: INFO nova.compute.manager [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Terminating instance
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-144c0f7e-bdbb-4251-901f-e1becbabc9fb req-bc0ee0e0-6667-4112-981e-10c329f929f4 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received event network-vif-unplugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-144c0f7e-bdbb-4251-901f-e1becbabc9fb req-bc0ee0e0-6667-4112-981e-10c329f929f4 service nova] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-144c0f7e-bdbb-4251-901f-e1becbabc9fb req-bc0ee0e0-6667-4112-981e-10c329f929f4 service nova] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-144c0f7e-bdbb-4251-901f-e1becbabc9fb req-bc0ee0e0-6667-4112-981e-10c329f929f4 service nova] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-144c0f7e-bdbb-4251-901f-e1becbabc9fb req-bc0ee0e0-6667-4112-981e-10c329f929f4 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] No waiting events found dispatching network-vif-unplugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-144c0f7e-bdbb-4251-901f-e1becbabc9fb req-bc0ee0e0-6667-4112-981e-10c329f929f4 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received event network-vif-unplugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:35:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Instance destroyed successfully.
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.objects.instance [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lazy-loading 'resources' on Instance uuid daeb5cce-969d-4671-872d-4c68f593d0da {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:32:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1102294138',display_name='tempest-AttachVolumeNegativeTest-server-1102294138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1102294138',id=39,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD5I0rrkpSDEBi38/RcSuEZ9L0+guNBPC8pKx7O3WgYJlJHdwmUdhZs09ma63T6m33wRQbB4i4uMqJmU0lrjHOgPjgoll4GwWmT8UuJp4n+eFMO8UMqPgdryAJ4zU+IvdA==',key_name='tempest-keypair-1923963830',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:32:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c2d5b81e2d940589392aa33ffb900e2',ramdisk_id='',reservation_id='r-w46bf48c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2132166828',owner_user_name='tempest-AttachVolumeNegativeTest-2132166828-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='494e2c6ede5c47ed8af6d1399ad8a06a',uuid=daeb5cce-969d-4671-872d-4c68f593d0da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converting VIF {"id": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "address": "fa:16:3e:e5:56:fb", "network": {"id": "8bb47a81-c0f2-4453-be0e-9ee5f17fe202", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-432623926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c2d5b81e2d940589392aa33ffb900e2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8066b09b-2f", "ovs_interfaceid": "8066b09b-2f4a-4365-ad3f-1d3d2650222c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:56:fb,bridge_name='br-int',has_traffic_filtering=True,id=8066b09b-2f4a-4365-ad3f-1d3d2650222c,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8066b09b-2f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG os_vif [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:56:fb,bridge_name='br-int',has_traffic_filtering=True,id=8066b09b-2f4a-4365-ad3f-1d3d2650222c,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8066b09b-2f') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8066b09b-2f, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ad7686d-e632-4b2c-b362-2bad18da626f) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:03 user nova-compute[74892]: INFO os_vif [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:56:fb,bridge_name='br-int',has_traffic_filtering=True,id=8066b09b-2f4a-4365-ad3f-1d3d2650222c,network=Network(8bb47a81-c0f2-4453-be0e-9ee5f17fe202),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8066b09b-2f')
Nov 15 14:35:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Deleting instance files /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da_del
Nov 15 14:35:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Deletion of /opt/stack/data/nova/instances/daeb5cce-969d-4671-872d-4c68f593d0da_del complete
Nov 15 14:35:03 user nova-compute[74892]: INFO nova.compute.manager [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 14:35:03 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:35:03 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:35:04 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:04 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Took 0.71 seconds to deallocate network for instance.
Nov 15 14:35:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:04 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:35:04 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:35:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:05 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Deleted allocations for instance daeb5cce-969d-4671-872d-4c68f593d0da
Nov 15 14:35:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7bbb8831-a87e-4e21-a692-850968d9b3a2 tempest-AttachVolumeNegativeTest-2132166828 tempest-AttachVolumeNegativeTest-2132166828-project-member] Lock "daeb5cce-969d-4671-872d-4c68f593d0da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.979s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-749b6ec3-5fb8-4a99-adac-cb557034ac5f req-4e5c8d28-4b4f-4c79-bd14-4e6828d401a0 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received event network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-749b6ec3-5fb8-4a99-adac-cb557034ac5f req-4e5c8d28-4b4f-4c79-bd14-4e6828d401a0 service nova] Acquiring lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-749b6ec3-5fb8-4a99-adac-cb557034ac5f req-4e5c8d28-4b4f-4c79-bd14-4e6828d401a0 service nova] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-749b6ec3-5fb8-4a99-adac-cb557034ac5f req-4e5c8d28-4b4f-4c79-bd14-4e6828d401a0 service nova] Lock "daeb5cce-969d-4671-872d-4c68f593d0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-749b6ec3-5fb8-4a99-adac-cb557034ac5f req-4e5c8d28-4b4f-4c79-bd14-4e6828d401a0 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] No waiting events found dispatching network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:05 user nova-compute[74892]: WARNING nova.compute.manager [req-749b6ec3-5fb8-4a99-adac-cb557034ac5f req-4e5c8d28-4b4f-4c79-bd14-4e6828d401a0 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received unexpected event network-vif-plugged-8066b09b-2f4a-4365-ad3f-1d3d2650222c for instance with vm_state deleted and task_state None.
Nov 15 14:35:05 user nova-compute[74892]: DEBUG nova.compute.manager [req-749b6ec3-5fb8-4a99-adac-cb557034ac5f req-4e5c8d28-4b4f-4c79-bd14-4e6828d401a0 service nova] [instance: daeb5cce-969d-4671-872d-4c68f593d0da] Received event network-vif-deleted-8066b09b-2f4a-4365-ad3f-1d3d2650222c {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:35:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:35:10 user nova-compute[74892]: INFO nova.compute.claims [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Claim successful on node user
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:35:10 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:35:10 user nova-compute[74892]: DEBUG nova.policy [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29fa0ea399dc4bafb5d2926ae76261c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16fe2666f7194df390f9764790c3663d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:35:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Creating image(s)
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.166s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk 1073741824" returned: 0 in 0.053s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Successfully created port: 1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.213s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Cannot resize image /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Ensure instance console log exists: /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Successfully updated port: 1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-b98558d2-2328-4ffa-ae91-d722eabd8ca4 req-ff791927-a98e-4dba-badf-607e4e851c00 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-changed-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-b98558d2-2328-4ffa-ae91-d722eabd8ca4 req-ff791927-a98e-4dba-badf-607e4e851c00 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Refreshing instance network info cache due to event network-changed-1932b387-4572-4580-a391-7f2a5791bf60. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b98558d2-2328-4ffa-ae91-d722eabd8ca4 req-ff791927-a98e-4dba-badf-607e4e851c00 service nova] Acquiring lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b98558d2-2328-4ffa-ae91-d722eabd8ca4 req-ff791927-a98e-4dba-badf-607e4e851c00 service nova] Acquired lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG nova.network.neutron [req-b98558d2-2328-4ffa-ae91-d722eabd8ca4 req-ff791927-a98e-4dba-badf-607e4e851c00 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Refreshing network info cache for port 1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG nova.network.neutron [req-b98558d2-2328-4ffa-ae91-d722eabd8ca4 req-ff791927-a98e-4dba-badf-607e4e851c00 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG nova.network.neutron [req-b98558d2-2328-4ffa-ae91-d722eabd8ca4 req-ff791927-a98e-4dba-badf-607e4e851c00 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b98558d2-2328-4ffa-ae91-d722eabd8ca4 req-ff791927-a98e-4dba-badf-607e4e851c00 service nova] Releasing lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquired lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:35:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.network.neutron [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Releasing lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance network_info: |[{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Start _get_guest_xml network_info=[{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:35:13 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:35:13 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1548300691',display_name='tempest-ServerRescueNegativeTestJSON-server-1548300691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1548300691',id=41,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZK0hMshfQI1nStccFJqSEJ4xCSBNif9T2xOmcZn+l9xds2ajFEa1z4u685xKg8EvnnI27QJwutQJETIhwGdLFJefb+qriPiiEmFaBnvjjARzi/805grNEMOLd8aE8MQ==',key_name='tempest-keypair-1639010971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-61x2097t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:35:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=9ae2fc25-ebaf-4ec6-aa39-024abc893e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:91,bridge_name='br-int',has_traffic_filtering=True,id=1932b387-4572-4580-a391-7f2a5791bf60,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932b387-45') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.objects.instance [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:35:13 user nova-compute[74892]:   <uuid>9ae2fc25-ebaf-4ec6-aa39-024abc893e3d</uuid>
Nov 15 14:35:13 user nova-compute[74892]:   <name>instance-00000029</name>
Nov 15 14:35:13 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:35:13 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:35:13 user nova-compute[74892]:   <metadata>
Nov 15 14:35:13 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:35:13 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:35:13 user nova-compute[74892]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1548300691</nova:name>
Nov 15 14:35:13 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:35:13</nova:creationTime>
Nov 15 14:35:13 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:35:13 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:35:13 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:35:13 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:35:13 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:35:13 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:35:13 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:35:13 user nova-compute[74892]:       <nova:owner>
Nov 15 14:35:13 user nova-compute[74892]:         <nova:user uuid="29fa0ea399dc4bafb5d2926ae76261c3">tempest-ServerRescueNegativeTestJSON-454831858-project-member</nova:user>
Nov 15 14:35:13 user nova-compute[74892]:         <nova:project uuid="16fe2666f7194df390f9764790c3663d">tempest-ServerRescueNegativeTestJSON-454831858</nova:project>
Nov 15 14:35:13 user nova-compute[74892]:       </nova:owner>
Nov 15 14:35:13 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:35:13 user nova-compute[74892]:       <nova:ports>
Nov 15 14:35:13 user nova-compute[74892]:         <nova:port uuid="1932b387-4572-4580-a391-7f2a5791bf60">
Nov 15 14:35:13 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:35:13 user nova-compute[74892]:         </nova:port>
Nov 15 14:35:13 user nova-compute[74892]:       </nova:ports>
Nov 15 14:35:13 user nova-compute[74892]:     </nova:instance>
Nov 15 14:35:13 user nova-compute[74892]:   </metadata>
Nov 15 14:35:13 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:35:13 user nova-compute[74892]:     <system>
Nov 15 14:35:13 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:35:13 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:35:13 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:35:13 user nova-compute[74892]:       <entry name="serial">9ae2fc25-ebaf-4ec6-aa39-024abc893e3d</entry>
Nov 15 14:35:13 user nova-compute[74892]:       <entry name="uuid">9ae2fc25-ebaf-4ec6-aa39-024abc893e3d</entry>
Nov 15 14:35:13 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:35:13 user nova-compute[74892]:     </system>
Nov 15 14:35:13 user nova-compute[74892]:   </sysinfo>
Nov 15 14:35:13 user nova-compute[74892]:   <os>
Nov 15 14:35:13 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:35:13 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:35:13 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:35:13 user nova-compute[74892]:   </os>
Nov 15 14:35:13 user nova-compute[74892]:   <features>
Nov 15 14:35:13 user nova-compute[74892]:     <acpi/>
Nov 15 14:35:13 user nova-compute[74892]:     <apic/>
Nov 15 14:35:13 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:35:13 user nova-compute[74892]:   </features>
Nov 15 14:35:13 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:35:13 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:35:13 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:35:13 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:35:13 user nova-compute[74892]:   </clock>
Nov 15 14:35:13 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:35:13 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:35:13 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:35:13 user nova-compute[74892]:   </cpu>
Nov 15 14:35:13 user nova-compute[74892]:   <devices>
Nov 15 14:35:13 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:35:13 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:35:13 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk"/>
Nov 15 14:35:13 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:35:13 user nova-compute[74892]:     </disk>
Nov 15 14:35:13 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:35:13 user nova-compute[74892]:       <mac address="fa:16:3e:5a:18:91"/>
Nov 15 14:35:13 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:35:13 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:35:13 user nova-compute[74892]:       <target dev="tap1932b387-45"/>
Nov 15 14:35:13 user nova-compute[74892]:     </interface>
Nov 15 14:35:13 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:35:13 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/console.log" append="off"/>
Nov 15 14:35:13 user nova-compute[74892]:     </serial>
Nov 15 14:35:13 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:35:13 user nova-compute[74892]:     <video>
Nov 15 14:35:13 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:35:13 user nova-compute[74892]:     </video>
Nov 15 14:35:13 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:35:13 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:35:13 user nova-compute[74892]:     </rng>
Nov 15 14:35:13 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:35:13 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:35:13 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:35:13 user nova-compute[74892]:     </memballoon>
Nov 15 14:35:13 user nova-compute[74892]:   </devices>
Nov 15 14:35:13 user nova-compute[74892]: </domain>
Nov 15 14:35:13 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1548300691',display_name='tempest-ServerRescueNegativeTestJSON-server-1548300691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1548300691',id=41,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZK0hMshfQI1nStccFJqSEJ4xCSBNif9T2xOmcZn+l9xds2ajFEa1z4u685xKg8EvnnI27QJwutQJETIhwGdLFJefb+qriPiiEmFaBnvjjARzi/805grNEMOLd8aE8MQ==',key_name='tempest-keypair-1639010971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-61x2097t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:35:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=9ae2fc25-ebaf-4ec6-aa39-024abc893e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:91,bridge_name='br-int',has_traffic_filtering=True,id=1932b387-4572-4580-a391-7f2a5791bf60,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932b387-45') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG os_vif [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:91,bridge_name='br-int',has_traffic_filtering=True,id=1932b387-4572-4580-a391-7f2a5791bf60,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932b387-45') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0e1701d-6bb4-57b1-b354-e142ef3c1f58', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1932b387-45, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1932b387-45, col_values=(('qos', UUID('f2846102-b393-472f-887c-aeb8b636a66e')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1932b387-45, col_values=(('external_ids', {'iface-id': '1932b387-4572-4580-a391-7f2a5791bf60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:18:91', 'vm-uuid': '9ae2fc25-ebaf-4ec6-aa39-024abc893e3d'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:13 user nova-compute[74892]: INFO os_vif [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:18:91,bridge_name='br-int',has_traffic_filtering=True,id=1932b387-4572-4580-a391-7f2a5791bf60,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932b387-45')
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:35:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No VIF found with MAC fa:16:3e:5a:18:91, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:35:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-37867a75-e521-431f-a1bf-b496335c838f req-8da3b261-3f3d-4287-b83b-4202b055b070 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37867a75-e521-431f-a1bf-b496335c838f req-8da3b261-3f3d-4287-b83b-4202b055b070 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37867a75-e521-431f-a1bf-b496335c838f req-8da3b261-3f3d-4287-b83b-4202b055b070 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37867a75-e521-431f-a1bf-b496335c838f req-8da3b261-3f3d-4287-b83b-4202b055b070 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-37867a75-e521-431f-a1bf-b496335c838f req-8da3b261-3f3d-4287-b83b-4202b055b070 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:14 user nova-compute[74892]: WARNING nova.compute.manager [req-37867a75-e521-431f-a1bf-b496335c838f req-8da3b261-3f3d-4287-b83b-4202b055b070 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state building and task_state spawning.
Nov 15 14:35:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:35:16 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance spawned successfully.
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:35:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:17 user nova-compute[74892]: INFO nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 15 14:35:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:35:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-7f6d032d-f597-486e-a75a-e14f8abbbae9 req-7dd58071-7d7f-4705-8fa0-8812e8fb89ef service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7f6d032d-f597-486e-a75a-e14f8abbbae9 req-7dd58071-7d7f-4705-8fa0-8812e8fb89ef service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7f6d032d-f597-486e-a75a-e14f8abbbae9 req-7dd58071-7d7f-4705-8fa0-8812e8fb89ef service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7f6d032d-f597-486e-a75a-e14f8abbbae9 req-7dd58071-7d7f-4705-8fa0-8812e8fb89ef service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:17 user nova-compute[74892]: DEBUG nova.compute.manager [req-7f6d032d-f597-486e-a75a-e14f8abbbae9 req-7dd58071-7d7f-4705-8fa0-8812e8fb89ef service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:17 user nova-compute[74892]: WARNING nova.compute.manager [req-7f6d032d-f597-486e-a75a-e14f8abbbae9 req-7dd58071-7d7f-4705-8fa0-8812e8fb89ef service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state building and task_state spawning.
Nov 15 14:35:17 user nova-compute[74892]: INFO nova.compute.manager [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Took 6.72 seconds to build instance.
Nov 15 14:35:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a2edb05-8d9b-4fdf-880f-63c266d0d70c tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.826s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-8550732c-b3ae-4d62-a172-f4d6a7affb0c req-1be105f5-1bb2-49b7-b029-74cd08da7759 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-changed-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-8550732c-b3ae-4d62-a172-f4d6a7affb0c req-1be105f5-1bb2-49b7-b029-74cd08da7759 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Refreshing instance network info cache due to event network-changed-2f5ad71a-e731-40f9-9895-728ca6306197. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:35:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8550732c-b3ae-4d62-a172-f4d6a7affb0c req-1be105f5-1bb2-49b7-b029-74cd08da7759 service nova] Acquiring lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:35:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8550732c-b3ae-4d62-a172-f4d6a7affb0c req-1be105f5-1bb2-49b7-b029-74cd08da7759 service nova] Acquired lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:35:27 user nova-compute[74892]: DEBUG nova.network.neutron [req-8550732c-b3ae-4d62-a172-f4d6a7affb0c req-1be105f5-1bb2-49b7-b029-74cd08da7759 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Refreshing network info cache for port 2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG nova.network.neutron [req-8550732c-b3ae-4d62-a172-f4d6a7affb0c req-1be105f5-1bb2-49b7-b029-74cd08da7759 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Updated VIF entry in instance network info cache for port 2f5ad71a-e731-40f9-9895-728ca6306197. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG nova.network.neutron [req-8550732c-b3ae-4d62-a172-f4d6a7affb0c req-1be105f5-1bb2-49b7-b029-74cd08da7759 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Updating instance_info_cache with network_info: [{"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8550732c-b3ae-4d62-a172-f4d6a7affb0c req-1be105f5-1bb2-49b7-b029-74cd08da7759 service nova] Releasing lock "refresh_cache-c7757be7-596d-4e19-a909-362703d903a6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c7757be7-596d-4e19-a909-362703d903a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:28 user nova-compute[74892]: INFO nova.compute.manager [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Terminating instance
Nov 15 14:35:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:28 user nova-compute[74892]: INFO nova.compute.manager [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Terminating instance
Nov 15 14:35:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-ba2689ac-8122-473d-9226-ed353eb29ee0 req-014e1bb5-d49b-4d15-897f-39095fcdb459 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-unplugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ba2689ac-8122-473d-9226-ed353eb29ee0 req-014e1bb5-d49b-4d15-897f-39095fcdb459 service nova] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ba2689ac-8122-473d-9226-ed353eb29ee0 req-014e1bb5-d49b-4d15-897f-39095fcdb459 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ba2689ac-8122-473d-9226-ed353eb29ee0 req-014e1bb5-d49b-4d15-897f-39095fcdb459 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-ba2689ac-8122-473d-9226-ed353eb29ee0 req-014e1bb5-d49b-4d15-897f-39095fcdb459 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] No waiting events found dispatching network-vif-unplugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-ba2689ac-8122-473d-9226-ed353eb29ee0 req-014e1bb5-d49b-4d15-897f-39095fcdb459 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-unplugged-2f5ad71a-e731-40f9-9895-728ca6306197 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:35:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c7757be7-596d-4e19-a909-362703d903a6] Instance destroyed successfully.
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.objects.instance [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'resources' on Instance uuid c7757be7-596d-4e19-a909-362703d903a6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:35:29 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Instance destroyed successfully.
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'resources' on Instance uuid 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1890235898',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1890235898',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1890235898',id=40,image_ref='5543328b-0f3d-4299-812f-7644ecf69938',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLpunr8uBuUR4o4QbFMGkbe/RjI1Zal/pQ/oqvjTy888eEU9Vrar4qcXyVyAWjy+KaBR2VX34J/MIxllEyAw/g9Zm25Nws98b3HHfYinI4VHYBGJO1ed8kCbxqZcCrSBA==',key_name='tempest-keypair-1887068408',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:33:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-8gg38qco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1799633332',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:33:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c73da782783d41dbb370c3df04dec208',uuid=c7757be7-596d-4e19-a909-362703d903a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "2f5ad71a-e731-40f9-9895-728ca6306197", "address": "fa:16:3e:0e:a0:6b", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ad71a-e7", "ovs_interfaceid": "2f5ad71a-e731-40f9-9895-728ca6306197", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f5ad71a-e731-40f9-9895-728ca6306197,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ad71a-e7') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_vif [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f5ad71a-e731-40f9-9895-728ca6306197,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ad71a-e7') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:19:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1670851347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1670851347',id=13,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-b2mcwnk1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:23:28Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=8fbd39df-d62a-4d1b-ac46-f0a2503a3987,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "d605c970-50ca-4127-bae5-c19aa1a429e0", "address": "fa:16:3e:1e:a4:af", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd605c970-50", "ovs_interfaceid": "d605c970-50ca-4127-bae5-c19aa1a429e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a4:af,bridge_name='br-int',has_traffic_filtering=True,id=d605c970-50ca-4127-bae5-c19aa1a429e0,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd605c970-50') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_vif [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a4:af,bridge_name='br-int',has_traffic_filtering=True,id=d605c970-50ca-4127-bae5-c19aa1a429e0,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd605c970-50') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f5ad71a-e7, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd605c970-50, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f6b7c54-7000-4266-b06c-36ceed7152f3) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b250448c-9605-4c24-9f3b-f944ff9d2938) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: INFO os_vif [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=2f5ad71a-e731-40f9-9895-728ca6306197,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ad71a-e7')
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:35:29 user nova-compute[74892]: INFO os_vif [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:a4:af,bridge_name='br-int',has_traffic_filtering=True,id=d605c970-50ca-4127-bae5-c19aa1a429e0,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd605c970-50')
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQEJFcTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:35:29 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JdsOfZtL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:35:29 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb9b05-61ab-4505-8fbb-0cba6383b3e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:35:29 user nova-compute[74892]: No targets found.
Nov 15 14:35:29 user nova-compute[74892]: iSNS:
Nov 15 14:35:29 user nova-compute[74892]: No targets found.
Nov 15 14:35:29 user nova-compute[74892]: STATIC:
Nov 15 14:35:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc
Nov 15 14:35:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:35:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:35:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74
Nov 15 14:35:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:35:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:35:29 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:35:29 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:35:29 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:35:29 user nova-compute[74892]: FIRMWARE:
Nov 15 14:35:29 user nova-compute[74892]: No targets found.
Nov 15 14:35:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:35:29 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:35:29 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c7f73a-8945-43a9-a01d-f58fb5d34bba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[933314d8-51cb-442b-ab54-656d0286db45]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:35:29 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:35:29 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:35:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:35:29 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:35:29 user nova-compute[74892]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc (non-flash)
Nov 15 14:35:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd4031e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1add4e0-7727-4ef9-aa7f-6fa0c01fe19d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac67c68-d4a6-4746-bdad-bef0dbd9fd8c]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[488a83f9-5e2b-4021-9a81-222939a95784]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3349bf61-7978-45c7-9d24-018e1662aeb7]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a84535-8371-48ed-a3cd-b050ec4d8190]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:35:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.123s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[809ac926-3a47-4814-b03e-1a4595e532ff]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc, portal: 172.16.0.220,3260]
Nov 15 14:35:30 user nova-compute[74892]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc, portal: 172.16.0.220,3260] successful.
Nov 15 14:35:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6999e542-84fa-4fc0-9e1c-74b9473604fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8604c52e-c4cd-40e0-8260-908ad06525e8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== disconnect_volume: return (423ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:35:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Deleting instance files /opt/stack/data/nova/instances/c7757be7-596d-4e19-a909-362703d903a6_del
Nov 15 14:35:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Deletion of /opt/stack/data/nova/instances/c7757be7-596d-4e19-a909-362703d903a6_del complete
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.418s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[737b1f85-1826-491e-9570-2d619e0973b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:35:30 user nova-compute[74892]: No targets found.
Nov 15 14:35:30 user nova-compute[74892]: iSNS:
Nov 15 14:35:30 user nova-compute[74892]: No targets found.
Nov 15 14:35:30 user nova-compute[74892]: STATIC:
Nov 15 14:35:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74
Nov 15 14:35:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:35:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:35:30 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe
Nov 15 14:35:30 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:35:30 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:35:30 user nova-compute[74892]: FIRMWARE:
Nov 15 14:35:30 user nova-compute[74892]: No targets found.
Nov 15 14:35:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:35:30 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:35:30 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feb9541-ec6c-4c52-841e-1e28e2d64c73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc26364-5b13-4e52-b697-579ca6a3c20f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:35:30 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:35:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe (non-flash)
Nov 15 14:35:30 user nova-compute[74892]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:35:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd005f2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe'): ({'sdd'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Removing single pathed devices sdd {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:35:30 user nova-compute[74892]: INFO nova.compute.manager [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Took 1.73 seconds to destroy the instance on the hypervisor.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: c7757be7-596d-4e19-a909-362703d903a6] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: c7757be7-596d-4e19-a909-362703d903a6] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1211a0c-99e5-47f9-8c03-6ff4b03f3a0c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bca551-e0c9-4ec9-8a56-1f7e6edce532]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Flushing IO for device /dev/sdd {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c45de1-9fe3-4c6d-853b-c1590710d3df]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2fe4d7-0c87-4b39-aee4-2ab71f02a9d3]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] SCSI volumes sdd have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dda063-6ffc-49fa-b585-babf8bcca404]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90f03f2-f449-4d89-b833-7f171708fc60]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe, portal: 172.16.0.220,3260]
Nov 15 14:35:30 user nova-compute[74892]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe, portal: 172.16.0.220,3260] successful.
Nov 15 14:35:30 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7a39c82-65d7-46bd-a3ce-3ab2523326fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[142f0721-edef-4601-8a23-5bbbed6e814d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] <== disconnect_volume: return (756ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:35:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Deleting instance files /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987_del
Nov 15 14:35:30 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Deletion of /opt/stack/data/nova/instances/8fbd39df-d62a-4d1b-ac46-f0a2503a3987_del complete
Nov 15 14:35:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:30 user nova-compute[74892]: INFO nova.compute.manager [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Took 1.87 seconds to destroy the instance on the hypervisor.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] No waiting events found dispatching network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: WARNING nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received unexpected event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 for instance with vm_state active and task_state deleting.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: WARNING nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state deleting.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] No waiting events found dispatching network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: WARNING nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received unexpected event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 for instance with vm_state active and task_state deleting.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] No waiting events found dispatching network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: WARNING nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received unexpected event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 for instance with vm_state active and task_state deleting.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-unplugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] No waiting events found dispatching network-vif-unplugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-unplugged-2f5ad71a-e731-40f9-9895-728ca6306197 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "c7757be7-596d-4e19-a909-362703d903a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "c7757be7-596d-4e19-a909-362703d903a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] No waiting events found dispatching network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: WARNING nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received unexpected event network-vif-plugged-2f5ad71a-e731-40f9-9895-728ca6306197 for instance with vm_state active and task_state deleting.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: WARNING nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state deleting.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: WARNING nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state active and task_state deleting.
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.compute.manager [req-f26912c1-9acb-4b6a-b051-fc924a79e302 req-47728433-0df3-48ef-b416-d876646e1358 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-unplugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:35:30 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: c7757be7-596d-4e19-a909-362703d903a6] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-a4b3dcb7-f431-481a-9d17-3c554e73fbe8 req-f83262eb-69a2-4565-b96f-c7c7bc4242d1 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Received event network-vif-deleted-2f5ad71a-e731-40f9-9895-728ca6306197 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:31 user nova-compute[74892]: INFO nova.compute.manager [req-a4b3dcb7-f431-481a-9d17-3c554e73fbe8 req-f83262eb-69a2-4565-b96f-c7c7bc4242d1 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Neutron deleted interface 2f5ad71a-e731-40f9-9895-728ca6306197; detaching it from the instance and deleting it from the info cache
Nov 15 14:35:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-a4b3dcb7-f431-481a-9d17-3c554e73fbe8 req-f83262eb-69a2-4565-b96f-c7c7bc4242d1 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:31 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: c7757be7-596d-4e19-a909-362703d903a6] Took 0.80 seconds to deallocate network for instance.
Nov 15 14:35:31 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-af7ade49-b856-4f65-bf12-6dd795336a0f req-79f6d56a-5181-4994-a125-594107520607 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-deleted-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:31 user nova-compute[74892]: INFO nova.compute.manager [req-af7ade49-b856-4f65-bf12-6dd795336a0f req-79f6d56a-5181-4994-a125-594107520607 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Neutron deleted interface d605c970-50ca-4127-bae5-c19aa1a429e0; detaching it from the instance and deleting it from the info cache
Nov 15 14:35:31 user nova-compute[74892]: DEBUG nova.network.neutron [req-af7ade49-b856-4f65-bf12-6dd795336a0f req-79f6d56a-5181-4994-a125-594107520607 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:31 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Took 0.51 seconds to deallocate network for instance.
Nov 15 14:35:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-a4b3dcb7-f431-481a-9d17-3c554e73fbe8 req-f83262eb-69a2-4565-b96f-c7c7bc4242d1 service nova] [instance: c7757be7-596d-4e19-a909-362703d903a6] Detach interface failed, port_id=2f5ad71a-e731-40f9-9895-728ca6306197, reason: Instance c7757be7-596d-4e19-a909-362703d903a6 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:35:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-af7ade49-b856-4f65-bf12-6dd795336a0f req-79f6d56a-5181-4994-a125-594107520607 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Detach interface failed, port_id=d605c970-50ca-4127-bae5-c19aa1a429e0, reason: Instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:35:31 user nova-compute[74892]: INFO nova.compute.manager [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Took 0.70 seconds to detach 1 volumes for instance.
Nov 15 14:35:31 user nova-compute[74892]: INFO nova.compute.manager [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Took 0.76 seconds to detach 1 volumes for instance.
Nov 15 14:35:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c7757be7-596d-4e19-a909-362703d903a6] Deleting volume: 6999e542-84fa-4fc0-9e1c-74b9473604fc {{(pid=74892) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 14:35:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:32 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:35:32 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:35:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.192s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:32 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Deleted allocations for instance 8fbd39df-d62a-4d1b-ac46-f0a2503a3987
Nov 15 14:35:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1bab2389-1072-48a8-8e06-bfecf05fd8b4 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.553s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:32 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:35:32 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:35:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:32 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Deleted allocations for instance c7757be7-596d-4e19-a909-362703d903a6
Nov 15 14:35:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9805fbd8-6bb8-4d28-983c-07cb3de9f763 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c7757be7-596d-4e19-a909-362703d903a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.019s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-d164631b-0730-4625-a44b-3fdafbdf0463 req-d34a3c06-5e81-4a47-8c0d-c9cb6dbc7cc1 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d164631b-0730-4625-a44b-3fdafbdf0463 req-d34a3c06-5e81-4a47-8c0d-c9cb6dbc7cc1 service nova] Acquiring lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d164631b-0730-4625-a44b-3fdafbdf0463 req-d34a3c06-5e81-4a47-8c0d-c9cb6dbc7cc1 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d164631b-0730-4625-a44b-3fdafbdf0463 req-d34a3c06-5e81-4a47-8c0d-c9cb6dbc7cc1 service nova] Lock "8fbd39df-d62a-4d1b-ac46-f0a2503a3987-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-d164631b-0730-4625-a44b-3fdafbdf0463 req-d34a3c06-5e81-4a47-8c0d-c9cb6dbc7cc1 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] No waiting events found dispatching network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:33 user nova-compute[74892]: WARNING nova.compute.manager [req-d164631b-0730-4625-a44b-3fdafbdf0463 req-d34a3c06-5e81-4a47-8c0d-c9cb6dbc7cc1 service nova] [instance: 8fbd39df-d62a-4d1b-ac46-f0a2503a3987] Received unexpected event network-vif-plugged-d605c970-50ca-4127-bae5-c19aa1a429e0 for instance with vm_state deleted and task_state None.
Nov 15 14:35:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:49 user nova-compute[74892]: INFO nova.compute.manager [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Terminating instance
Nov 15 14:35:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-35b1175b-be64-4fa1-b47a-9e9d1a588cab req-a9772809-8cfd-4794-a434-281819fc7e3e service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-vif-unplugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-35b1175b-be64-4fa1-b47a-9e9d1a588cab req-a9772809-8cfd-4794-a434-281819fc7e3e service nova] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-35b1175b-be64-4fa1-b47a-9e9d1a588cab req-a9772809-8cfd-4794-a434-281819fc7e3e service nova] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-35b1175b-be64-4fa1-b47a-9e9d1a588cab req-a9772809-8cfd-4794-a434-281819fc7e3e service nova] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-35b1175b-be64-4fa1-b47a-9e9d1a588cab req-a9772809-8cfd-4794-a434-281819fc7e3e service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] No waiting events found dispatching network-vif-unplugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-35b1175b-be64-4fa1-b47a-9e9d1a588cab req-a9772809-8cfd-4794-a434-281819fc7e3e service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-vif-unplugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Instance destroyed successfully.
Nov 15 14:35:50 user nova-compute[74892]: DEBUG nova.objects.instance [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lazy-loading 'resources' on Instance uuid 6c7fcea3-5818-4f0d-a0e8-91bef820d398 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1323533199',display_name='tempest-ServerActionsTestOtherA-server-1323533199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1323533199',id=3,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEAYrQU6nSVet5tzgbywuMLKRXUGFp83WkhTrmm3K23nSbNvGp2hE5FbGpb2ro9Sp2Zj8EUPtD0PUhWYJJxIL40zuWqGNDyNMdhurrWEl9UTWuLUWSJJCWCPfzDii6Uuw==',key_name='tempest-keypair-1945958825',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:17:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bbe544848b48449381967e24f274b7bd',ramdisk_id='',reservation_id='r-nc2vjnh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2044893964',owner_user_name='tempest-ServerActionsTestOtherA-2044893964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:17:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abe166e9b6134abf85db0e21ec1e100d',uuid=6c7fcea3-5818-4f0d-a0e8-91bef820d398,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converting VIF {"id": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "address": "fa:16:3e:b6:ca:7e", "network": {"id": "ba2af8ae-c3a4-4a40-9a56-eee96a33f135", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-643720614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bbe544848b48449381967e24f274b7bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0d9d737-8f", "ovs_interfaceid": "c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ca:7e,bridge_name='br-int',has_traffic_filtering=True,id=c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d9d737-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG os_vif [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ca:7e,bridge_name='br-int',has_traffic_filtering=True,id=c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d9d737-8f') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0d9d737-8f, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e10522e-749b-4f48-b480-5515b16eb274) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:35:50 user nova-compute[74892]: INFO os_vif [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:ca:7e,bridge_name='br-int',has_traffic_filtering=True,id=c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9,network=Network(ba2af8ae-c3a4-4a40-9a56-eee96a33f135),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0d9d737-8f')
Nov 15 14:35:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Deleting instance files /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398_del
Nov 15 14:35:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Deletion of /opt/stack/data/nova/instances/6c7fcea3-5818-4f0d-a0e8-91bef820d398_del complete
Nov 15 14:35:50 user nova-compute[74892]: INFO nova.compute.manager [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 15 14:35:50 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Took 0.41 seconds to deallocate network for instance.
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-2e433d18-d01d-47f6-a5e5-57510ddf4dc3 req-a0e1f3b2-42d3-49c3-b130-6eee5aedb454 service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-vif-deleted-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:51 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:35:51 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:35:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.244s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:51 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Deleted allocations for instance 6c7fcea3-5818-4f0d-a0e8-91bef820d398
Nov 15 14:35:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f6ed91f6-9979-4832-96d7-fafe55066192 tempest-ServerActionsTestOtherA-2044893964 tempest-ServerActionsTestOtherA-2044893964-project-member] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.576s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-51b44e89-5822-4af3-aa46-803cce785c5b req-6aa25c18-be98-41dd-bbbb-686ce8a7d80c service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received event network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:35:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-51b44e89-5822-4af3-aa46-803cce785c5b req-6aa25c18-be98-41dd-bbbb-686ce8a7d80c service nova] Acquiring lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-51b44e89-5822-4af3-aa46-803cce785c5b req-6aa25c18-be98-41dd-bbbb-686ce8a7d80c service nova] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-51b44e89-5822-4af3-aa46-803cce785c5b req-6aa25c18-be98-41dd-bbbb-686ce8a7d80c service nova] Lock "6c7fcea3-5818-4f0d-a0e8-91bef820d398-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-51b44e89-5822-4af3-aa46-803cce785c5b req-6aa25c18-be98-41dd-bbbb-686ce8a7d80c service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] No waiting events found dispatching network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:35:51 user nova-compute[74892]: WARNING nova.compute.manager [req-51b44e89-5822-4af3-aa46-803cce785c5b req-6aa25c18-be98-41dd-bbbb-686ce8a7d80c service nova] [instance: 6c7fcea3-5818-4f0d-a0e8-91bef820d398] Received unexpected event network-vif-plugged-c0d9d737-8fd3-4a19-b2d0-b9c9c550a7b9 for instance with vm_state deleted and task_state None.
Nov 15 14:35:52 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:35:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:35:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:35:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:35:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8274MB free_disk=25.035831451416016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 728aaeb0-c063-49da-8046-575c82f5fe4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:35:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:35:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:35:56 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:35:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:35:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:35:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:35:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:36:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:36:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:36:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:36:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:36:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:36:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:36:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:36:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:36:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:36:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:36:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:19 user nova-compute[74892]: INFO nova.compute.manager [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Terminating instance
Nov 15 14:36:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-e34c3a3b-87f7-4ece-90d1-bba528c8bf23 req-52bb1a14-2f19-47c5-9460-458223f42cef service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received event network-vif-unplugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e34c3a3b-87f7-4ece-90d1-bba528c8bf23 req-52bb1a14-2f19-47c5-9460-458223f42cef service nova] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e34c3a3b-87f7-4ece-90d1-bba528c8bf23 req-52bb1a14-2f19-47c5-9460-458223f42cef service nova] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e34c3a3b-87f7-4ece-90d1-bba528c8bf23 req-52bb1a14-2f19-47c5-9460-458223f42cef service nova] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-e34c3a3b-87f7-4ece-90d1-bba528c8bf23 req-52bb1a14-2f19-47c5-9460-458223f42cef service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] No waiting events found dispatching network-vif-unplugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:36:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-e34c3a3b-87f7-4ece-90d1-bba528c8bf23 req-52bb1a14-2f19-47c5-9460-458223f42cef service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received event network-vif-unplugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:20 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Instance destroyed successfully.
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.objects.instance [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lazy-loading 'resources' on Instance uuid a87f39af-29c7-40ee-86c9-ed04a07b9d2e {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:16:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1549254796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1549254796',id=1,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3fcc169292ce42fb9f54aab1db3869bd',ramdisk_id='',reservation_id='r-xzw84rld',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-760148567',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:18:37Z,user_data=None,user_id='eccd14bd0c974f4a83aba63fd70df073',uuid=a87f39af-29c7-40ee-86c9-ed04a07b9d2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converting VIF {"id": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "address": "fa:16:3e:da:ad:e3", "network": {"id": "fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-294544560-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3fcc169292ce42fb9f54aab1db3869bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc48b71e-a6", "ovs_interfaceid": "cc48b71e-a64c-4a11-847a-162c58b6f0b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ad:e3,bridge_name='br-int',has_traffic_filtering=True,id=cc48b71e-a64c-4a11-847a-162c58b6f0b9,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc48b71e-a6') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG os_vif [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ad:e3,bridge_name='br-int',has_traffic_filtering=True,id=cc48b71e-a64c-4a11-847a-162c58b6f0b9,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc48b71e-a6') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc48b71e-a6, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd4929ab-d470-4d7f-8b31-9d505130ca92) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:20 user nova-compute[74892]: INFO os_vif [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ad:e3,bridge_name='br-int',has_traffic_filtering=True,id=cc48b71e-a64c-4a11-847a-162c58b6f0b9,network=Network(fc78bc71-5bdb-4889-ad3d-4473b1f0ebb8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc48b71e-a6')
Nov 15 14:36:20 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Deleting instance files /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e_del
Nov 15 14:36:20 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Deletion of /opt/stack/data/nova/instances/a87f39af-29c7-40ee-86c9-ed04a07b9d2e_del complete
Nov 15 14:36:20 user nova-compute[74892]: INFO nova.compute.manager [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 14:36:20 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d065c08-46ec-4595-849e-2afc6ae56fcf req-3e299cee-d565-4928-bc9d-a7d2340caa56 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received event network-vif-deleted-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:20 user nova-compute[74892]: INFO nova.compute.manager [req-2d065c08-46ec-4595-849e-2afc6ae56fcf req-3e299cee-d565-4928-bc9d-a7d2340caa56 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Neutron deleted interface cc48b71e-a64c-4a11-847a-162c58b6f0b9; detaching it from the instance and deleting it from the info cache
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.network.neutron [req-2d065c08-46ec-4595-849e-2afc6ae56fcf req-3e299cee-d565-4928-bc9d-a7d2340caa56 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:36:20 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Took 0.43 seconds to deallocate network for instance.
Nov 15 14:36:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d065c08-46ec-4595-849e-2afc6ae56fcf req-3e299cee-d565-4928-bc9d-a7d2340caa56 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Detach interface failed, port_id=cc48b71e-a64c-4a11-847a-162c58b6f0b9, reason: Instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:21 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Deleted allocations for instance a87f39af-29c7-40ee-86c9-ed04a07b9d2e
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "728aaeb0-c063-49da-8046-575c82f5fe4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:21 user nova-compute[74892]: INFO nova.compute.manager [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Terminating instance
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-83a44115-715a-457c-ba74-9167d2516799 tempest-ServerBootFromVolumeStableRescueTest-760148567 tempest-ServerBootFromVolumeStableRescueTest-760148567-project-member] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.681s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-f80ffc61-b967-4532-ac7c-a7d61ef29591 req-dfb9dfd6-1114-4de2-b9fb-d127a76e228e service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received event network-vif-unplugged-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f80ffc61-b967-4532-ac7c-a7d61ef29591 req-dfb9dfd6-1114-4de2-b9fb-d127a76e228e service nova] Acquiring lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f80ffc61-b967-4532-ac7c-a7d61ef29591 req-dfb9dfd6-1114-4de2-b9fb-d127a76e228e service nova] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f80ffc61-b967-4532-ac7c-a7d61ef29591 req-dfb9dfd6-1114-4de2-b9fb-d127a76e228e service nova] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-f80ffc61-b967-4532-ac7c-a7d61ef29591 req-dfb9dfd6-1114-4de2-b9fb-d127a76e228e service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] No waiting events found dispatching network-vif-unplugged-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-f80ffc61-b967-4532-ac7c-a7d61ef29591 req-dfb9dfd6-1114-4de2-b9fb-d127a76e228e service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received event network-vif-unplugged-2971fb38-d954-4b27-8994-099dededaa9e for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:36:21 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Instance destroyed successfully.
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.objects.instance [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'resources' on Instance uuid 728aaeb0-c063-49da-8046-575c82f5fe4b {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1447620440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1447620440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1447620440',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHj/nmBSVNbz4DZs9U6QYxzfIkWx26+CsbQEVv7+wKWuA6n9YM43dbxTtCbEWGJwT77OIsqdp8KyDSq3M9++yp9E7FTHkf++r+QBx4bFeuyU3UB0DmZZJYKlAFwzrk+b9Q==',key_name='tempest-keypair-1870042644',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:31:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-ku3ynhf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:31:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c73da782783d41dbb370c3df04dec208',uuid=728aaeb0-c063-49da-8046-575c82f5fe4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "2971fb38-d954-4b27-8994-099dededaa9e", "address": "fa:16:3e:d5:b0:fa", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2971fb38-d9", "ovs_interfaceid": "2971fb38-d954-4b27-8994-099dededaa9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b0:fa,bridge_name='br-int',has_traffic_filtering=True,id=2971fb38-d954-4b27-8994-099dededaa9e,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2971fb38-d9') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG os_vif [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b0:fa,bridge_name='br-int',has_traffic_filtering=True,id=2971fb38-d954-4b27-8994-099dededaa9e,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2971fb38-d9') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-1902133d-6dc6-48a1-ba2a-f9102326fc0c req-9d71949c-817c-4ce7-a4c5-63eda7af9dd9 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received event network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1902133d-6dc6-48a1-ba2a-f9102326fc0c req-9d71949c-817c-4ce7-a4c5-63eda7af9dd9 service nova] Acquiring lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1902133d-6dc6-48a1-ba2a-f9102326fc0c req-9d71949c-817c-4ce7-a4c5-63eda7af9dd9 service nova] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1902133d-6dc6-48a1-ba2a-f9102326fc0c req-9d71949c-817c-4ce7-a4c5-63eda7af9dd9 service nova] Lock "a87f39af-29c7-40ee-86c9-ed04a07b9d2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-1902133d-6dc6-48a1-ba2a-f9102326fc0c req-9d71949c-817c-4ce7-a4c5-63eda7af9dd9 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] No waiting events found dispatching network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:36:21 user nova-compute[74892]: WARNING nova.compute.manager [req-1902133d-6dc6-48a1-ba2a-f9102326fc0c req-9d71949c-817c-4ce7-a4c5-63eda7af9dd9 service nova] [instance: a87f39af-29c7-40ee-86c9-ed04a07b9d2e] Received unexpected event network-vif-plugged-cc48b71e-a64c-4a11-847a-162c58b6f0b9 for instance with vm_state deleted and task_state None.
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2971fb38-d9, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5322ef8d-1837-4e56-9c2c-636d662a2108) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:21 user nova-compute[74892]: INFO os_vif [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:b0:fa,bridge_name='br-int',has_traffic_filtering=True,id=2971fb38-d954-4b27-8994-099dededaa9e,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2971fb38-d9')
Nov 15 14:36:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vClioSfI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:36:21 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:36:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2d51a-0ced-43af-a0b9-e81c8cd6a129]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:36:21 user nova-compute[74892]: No targets found.
Nov 15 14:36:21 user nova-compute[74892]: iSNS:
Nov 15 14:36:21 user nova-compute[74892]: No targets found.
Nov 15 14:36:21 user nova-compute[74892]: STATIC:
Nov 15 14:36:21 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74
Nov 15 14:36:21 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:36:21 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:36:21 user nova-compute[74892]: FIRMWARE:
Nov 15 14:36:21 user nova-compute[74892]: No targets found.
Nov 15 14:36:21 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:36:21 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:36:21 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:36:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f91377b-53c0-4860-b592-578a7e3b9dd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a910a55-98ca-4ed3-92c9-e17750d994d8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:36:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 (non-flash)
Nov 15 14:36:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2016fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c599e76e-4c05-4df3-a46f-3e5192e7255b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5de99b0-cdd5-4d90-bedf-78af1233da6f]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3479511e-d577-4a64-ae1b-00a0c052834a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee65b86-48b0-486b-931b-c480995eeb19]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa04679-779f-4acb-a6b5-8d8ce59cf99a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e662ca62-217b-424f-9155-4fd6110a0ff2]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74, portal: 172.16.0.220,3260]
Nov 15 14:36:22 user nova-compute[74892]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74, portal: 172.16.0.220,3260] successful.
Nov 15 14:36:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d83ab77-4b12-4570-91b2-f1f82ef37a74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f9e7ae-1ad6-4cae-af97-3199b38c0477]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== disconnect_volume: return (294ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:36:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Deleting instance files /opt/stack/data/nova/instances/728aaeb0-c063-49da-8046-575c82f5fe4b_del
Nov 15 14:36:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Deletion of /opt/stack/data/nova/instances/728aaeb0-c063-49da-8046-575c82f5fe4b_del complete
Nov 15 14:36:22 user nova-compute[74892]: INFO nova.compute.manager [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 14:36:22 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:36:22 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:36:22 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Took 0.65 seconds to deallocate network for instance.
Nov 15 14:36:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-c21aac8b-636c-4440-9439-f7d084028bf1 req-29b080e8-2274-433e-9b68-6f6b77796ef1 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received event network-vif-deleted-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-99c54a0f-16cf-4aac-8eff-b24c2f7c1bdb req-5df2a989-5283-48fd-a353-9abf0f152879 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received event network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-99c54a0f-16cf-4aac-8eff-b24c2f7c1bdb req-5df2a989-5283-48fd-a353-9abf0f152879 service nova] Acquiring lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-99c54a0f-16cf-4aac-8eff-b24c2f7c1bdb req-5df2a989-5283-48fd-a353-9abf0f152879 service nova] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-99c54a0f-16cf-4aac-8eff-b24c2f7c1bdb req-5df2a989-5283-48fd-a353-9abf0f152879 service nova] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-99c54a0f-16cf-4aac-8eff-b24c2f7c1bdb req-5df2a989-5283-48fd-a353-9abf0f152879 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] No waiting events found dispatching network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:36:23 user nova-compute[74892]: WARNING nova.compute.manager [req-99c54a0f-16cf-4aac-8eff-b24c2f7c1bdb req-5df2a989-5283-48fd-a353-9abf0f152879 service nova] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Received unexpected event network-vif-plugged-2971fb38-d954-4b27-8994-099dededaa9e for instance with vm_state active and task_state deleting.
Nov 15 14:36:23 user nova-compute[74892]: INFO nova.compute.manager [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Took 0.71 seconds to detach 1 volumes for instance.
Nov 15 14:36:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 728aaeb0-c063-49da-8046-575c82f5fe4b] Deleting volume: 4d83ab77-4b12-4570-91b2-f1f82ef37a74 {{(pid=74892) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:36:23 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:36:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:24 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Deleted allocations for instance 728aaeb0-c063-49da-8046-575c82f5fe4b
Nov 15 14:36:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-32ed3239-3804-4835-b99f-cfb3d3196587 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "728aaeb0-c063-49da-8046-575c82f5fe4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.973s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:52 user nova-compute[74892]: DEBUG nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:36:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:52 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:36:52 user nova-compute[74892]: INFO nova.compute.claims [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Claim successful on node user
Nov 15 14:36:52 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:36:52 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:36:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:36:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Creating image(s)
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "/opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "/opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "/opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.policy [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0502e4587dbc404da26bf5929fe2e3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8a34907a5846d68349968529f49dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk 1073741824" returned: 0 in 0.058s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Skipping network cache update for instance because it is Building. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.210s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:36:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Successfully created port: f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Cannot resize image /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Ensure instance console log exists: /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updating instance_info_cache with network_info: [{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Successfully updated port: f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquired lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-02fa082b-64da-4798-8384-c5791d003631 req-f278ed88-45dc-477e-8182-3e2f27ed2509 service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received event network-changed-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-02fa082b-64da-4798-8384-c5791d003631 req-f278ed88-45dc-477e-8182-3e2f27ed2509 service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Refreshing instance network info cache due to event network-changed-f2f9132a-eb34-49a0-992e-69eceaf9bfb9. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02fa082b-64da-4798-8384-c5791d003631 req-f278ed88-45dc-477e-8182-3e2f27ed2509 service nova] Acquiring lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:54 user nova-compute[74892]: DEBUG nova.network.neutron [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.network.neutron [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Updating instance_info_cache with network_info: [{"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Releasing lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Instance network_info: |[{"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02fa082b-64da-4798-8384-c5791d003631 req-f278ed88-45dc-477e-8182-3e2f27ed2509 service nova] Acquired lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.network.neutron [req-02fa082b-64da-4798-8384-c5791d003631 req-f278ed88-45dc-477e-8182-3e2f27ed2509 service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Refreshing network info cache for port f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Start _get_guest_xml network_info=[{"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:36:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1894120171',display_name='tempest-ServersNegativeTestJSON-server-1894120171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1894120171',id=42,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8a34907a5846d68349968529f49dfc',ramdisk_id='',reservation_id='r-32b3k2pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1366943078',owner_user_name='tempest-ServersNegativeTestJSON-1366943078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:36:53Z,user_data=None,user_id='0502e4587dbc404da26bf5929fe2e3de',uuid=66ff4a98-ce8a-47ab-9ce5-a5384b2de323,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converting VIF {"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d3:73,bridge_name='br-int',has_traffic_filtering=True,id=f2f9132a-eb34-49a0-992e-69eceaf9bfb9,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f9132a-eb') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lazy-loading 'pci_devices' on Instance uuid 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:36:55 user nova-compute[74892]:   <uuid>66ff4a98-ce8a-47ab-9ce5-a5384b2de323</uuid>
Nov 15 14:36:55 user nova-compute[74892]:   <name>instance-0000002a</name>
Nov 15 14:36:55 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:36:55 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:36:55 user nova-compute[74892]:   <metadata>
Nov 15 14:36:55 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:36:55 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:36:55 user nova-compute[74892]:       <nova:name>tempest-ServersNegativeTestJSON-server-1894120171</nova:name>
Nov 15 14:36:55 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:36:55</nova:creationTime>
Nov 15 14:36:55 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:36:55 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:36:55 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:36:55 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:36:55 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:36:55 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:36:55 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:36:55 user nova-compute[74892]:       <nova:owner>
Nov 15 14:36:55 user nova-compute[74892]:         <nova:user uuid="0502e4587dbc404da26bf5929fe2e3de">tempest-ServersNegativeTestJSON-1366943078-project-member</nova:user>
Nov 15 14:36:55 user nova-compute[74892]:         <nova:project uuid="5a8a34907a5846d68349968529f49dfc">tempest-ServersNegativeTestJSON-1366943078</nova:project>
Nov 15 14:36:55 user nova-compute[74892]:       </nova:owner>
Nov 15 14:36:55 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:36:55 user nova-compute[74892]:       <nova:ports>
Nov 15 14:36:55 user nova-compute[74892]:         <nova:port uuid="f2f9132a-eb34-49a0-992e-69eceaf9bfb9">
Nov 15 14:36:55 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 14:36:55 user nova-compute[74892]:         </nova:port>
Nov 15 14:36:55 user nova-compute[74892]:       </nova:ports>
Nov 15 14:36:55 user nova-compute[74892]:     </nova:instance>
Nov 15 14:36:55 user nova-compute[74892]:   </metadata>
Nov 15 14:36:55 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:36:55 user nova-compute[74892]:     <system>
Nov 15 14:36:55 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:36:55 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:36:55 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:36:55 user nova-compute[74892]:       <entry name="serial">66ff4a98-ce8a-47ab-9ce5-a5384b2de323</entry>
Nov 15 14:36:55 user nova-compute[74892]:       <entry name="uuid">66ff4a98-ce8a-47ab-9ce5-a5384b2de323</entry>
Nov 15 14:36:55 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:36:55 user nova-compute[74892]:     </system>
Nov 15 14:36:55 user nova-compute[74892]:   </sysinfo>
Nov 15 14:36:55 user nova-compute[74892]:   <os>
Nov 15 14:36:55 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:36:55 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:36:55 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:36:55 user nova-compute[74892]:   </os>
Nov 15 14:36:55 user nova-compute[74892]:   <features>
Nov 15 14:36:55 user nova-compute[74892]:     <acpi/>
Nov 15 14:36:55 user nova-compute[74892]:     <apic/>
Nov 15 14:36:55 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:36:55 user nova-compute[74892]:   </features>
Nov 15 14:36:55 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:36:55 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:36:55 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:36:55 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:36:55 user nova-compute[74892]:   </clock>
Nov 15 14:36:55 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:36:55 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:36:55 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:36:55 user nova-compute[74892]:   </cpu>
Nov 15 14:36:55 user nova-compute[74892]:   <devices>
Nov 15 14:36:55 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:36:55 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:36:55 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk"/>
Nov 15 14:36:55 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:36:55 user nova-compute[74892]:     </disk>
Nov 15 14:36:55 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:36:55 user nova-compute[74892]:       <mac address="fa:16:3e:c3:d3:73"/>
Nov 15 14:36:55 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:36:55 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:36:55 user nova-compute[74892]:       <target dev="tapf2f9132a-eb"/>
Nov 15 14:36:55 user nova-compute[74892]:     </interface>
Nov 15 14:36:55 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:36:55 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/console.log" append="off"/>
Nov 15 14:36:55 user nova-compute[74892]:     </serial>
Nov 15 14:36:55 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:36:55 user nova-compute[74892]:     <video>
Nov 15 14:36:55 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:36:55 user nova-compute[74892]:     </video>
Nov 15 14:36:55 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:36:55 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:36:55 user nova-compute[74892]:     </rng>
Nov 15 14:36:55 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:36:55 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:36:55 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:36:55 user nova-compute[74892]:     </memballoon>
Nov 15 14:36:55 user nova-compute[74892]:   </devices>
Nov 15 14:36:55 user nova-compute[74892]: </domain>
Nov 15 14:36:55 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1894120171',display_name='tempest-ServersNegativeTestJSON-server-1894120171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1894120171',id=42,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8a34907a5846d68349968529f49dfc',ramdisk_id='',reservation_id='r-32b3k2pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1366943078',owner_user_name='tempest-ServersNegativeTestJSON-1366943078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:36:53Z,user_data=None,user_id='0502e4587dbc404da26bf5929fe2e3de',uuid=66ff4a98-ce8a-47ab-9ce5-a5384b2de323,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converting VIF {"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d3:73,bridge_name='br-int',has_traffic_filtering=True,id=f2f9132a-eb34-49a0-992e-69eceaf9bfb9,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f9132a-eb') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG os_vif [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d3:73,bridge_name='br-int',has_traffic_filtering=True,id=f2f9132a-eb34-49a0-992e-69eceaf9bfb9,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f9132a-eb') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3849ee4b-b0b3-5af6-8004-3bcd2ebc2f4e', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2f9132a-eb, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2f9132a-eb, col_values=(('qos', UUID('0f93947e-7a11-4940-9820-c80e2902bfc3')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2f9132a-eb, col_values=(('external_ids', {'iface-id': 'f2f9132a-eb34-49a0-992e-69eceaf9bfb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:d3:73', 'vm-uuid': '66ff4a98-ce8a-47ab-9ce5-a5384b2de323'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:55 user nova-compute[74892]: INFO os_vif [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d3:73,bridge_name='br-int',has_traffic_filtering=True,id=f2f9132a-eb34-49a0-992e-69eceaf9bfb9,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f9132a-eb')
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] No VIF found with MAC fa:16:3e:c3:d3:73, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.network.neutron [req-02fa082b-64da-4798-8384-c5791d003631 req-f278ed88-45dc-477e-8182-3e2f27ed2509 service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Updated VIF entry in instance network info cache for port f2f9132a-eb34-49a0-992e-69eceaf9bfb9. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG nova.network.neutron [req-02fa082b-64da-4798-8384-c5791d003631 req-f278ed88-45dc-477e-8182-3e2f27ed2509 service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Updating instance_info_cache with network_info: [{"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02fa082b-64da-4798-8384-c5791d003631 req-f278ed88-45dc-477e-8182-3e2f27ed2509 service nova] Releasing lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:36:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-db58639d-fca5-4b7c-82c8-977cbb63b405 req-0ad54390-575f-4f6b-be1c-67f1a61be27c service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received event network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-db58639d-fca5-4b7c-82c8-977cbb63b405 req-0ad54390-575f-4f6b-be1c-67f1a61be27c service nova] Acquiring lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-db58639d-fca5-4b7c-82c8-977cbb63b405 req-0ad54390-575f-4f6b-be1c-67f1a61be27c service nova] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-db58639d-fca5-4b7c-82c8-977cbb63b405 req-0ad54390-575f-4f6b-be1c-67f1a61be27c service nova] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-db58639d-fca5-4b7c-82c8-977cbb63b405 req-0ad54390-575f-4f6b-be1c-67f1a61be27c service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] No waiting events found dispatching network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:36:59 user nova-compute[74892]: WARNING nova.compute.manager [req-db58639d-fca5-4b7c-82c8-977cbb63b405 req-0ad54390-575f-4f6b-be1c-67f1a61be27c service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received unexpected event network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 for instance with vm_state building and task_state spawning.
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-898963c6-59b1-4353-a8f9-2ea72c01d8a0 req-1151381d-8937-4479-b14f-bf73bdbeab69 service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received event network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-898963c6-59b1-4353-a8f9-2ea72c01d8a0 req-1151381d-8937-4479-b14f-bf73bdbeab69 service nova] Acquiring lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-898963c6-59b1-4353-a8f9-2ea72c01d8a0 req-1151381d-8937-4479-b14f-bf73bdbeab69 service nova] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-898963c6-59b1-4353-a8f9-2ea72c01d8a0 req-1151381d-8937-4479-b14f-bf73bdbeab69 service nova] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-898963c6-59b1-4353-a8f9-2ea72c01d8a0 req-1151381d-8937-4479-b14f-bf73bdbeab69 service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] No waiting events found dispatching network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:36:59 user nova-compute[74892]: WARNING nova.compute.manager [req-898963c6-59b1-4353-a8f9-2ea72c01d8a0 req-1151381d-8937-4479-b14f-bf73bdbeab69 service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received unexpected event network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 for instance with vm_state building and task_state spawning.
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:36:59 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Instance spawned successfully.
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:36:59 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:36:59 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8620MB free_disk=25.146526336669922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:36:59 user nova-compute[74892]: INFO nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Took 6.24 seconds to spawn the instance on the hypervisor.
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:36:59 user nova-compute[74892]: INFO nova.compute.manager [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Took 7.07 seconds to build instance.
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-00702a4b-8d00-4ae2-b743-765a8111fb7f tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.161s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:36:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3727405-c374-4118-856c-31fd1225d65d req-282e6eb3-e788-47d8-a83b-f991b7bd5974 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-changed-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3727405-c374-4118-856c-31fd1225d65d req-282e6eb3-e788-47d8-a83b-f991b7bd5974 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Refreshing instance network info cache due to event network-changed-1932b387-4572-4580-a391-7f2a5791bf60. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:37:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3727405-c374-4118-856c-31fd1225d65d req-282e6eb3-e788-47d8-a83b-f991b7bd5974 service nova] Acquiring lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:37:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3727405-c374-4118-856c-31fd1225d65d req-282e6eb3-e788-47d8-a83b-f991b7bd5974 service nova] Acquired lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:37:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3727405-c374-4118-856c-31fd1225d65d req-282e6eb3-e788-47d8-a83b-f991b7bd5974 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Refreshing network info cache for port 1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3727405-c374-4118-856c-31fd1225d65d req-282e6eb3-e788-47d8-a83b-f991b7bd5974 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updated VIF entry in instance network info cache for port 1932b387-4572-4580-a391-7f2a5791bf60. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG nova.network.neutron [req-e3727405-c374-4118-856c-31fd1225d65d req-282e6eb3-e788-47d8-a83b-f991b7bd5974 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3727405-c374-4118-856c-31fd1225d65d req-282e6eb3-e788-47d8-a83b-f991b7bd5974 service nova] Releasing lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'flavor' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:02 user nova-compute[74892]: INFO nova.compute.manager [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Attaching volume 5d7e496e-f8ca-4925-89d4-bb683e3b4172 to /dev/vdb
Nov 15 14:37:03 user nova-compute[74892]: DEBUG os_brick.utils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32231b9-72ca-48fa-a58a-de4b198f1c15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9b1725-ad61-45aa-b758-997d0c0e2e56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5afdcc1-7abe-4a9f-af9c-3096032a5a32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[964e2480-60e8-4b3a-b259-06bd3e9ba42f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:37:03 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:37:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca0868f-9521-457a-a599-83309d683f67]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG os_brick.utils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:37:03 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating existing volume attachment record: c8290362-27bd-4ed4-a3f5-6a2214d528df {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:37:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lorzRFBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:37:07 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:37:07 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:37:07 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80305fe-dcdb-4de0-84be-91e6ae9207e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:37:07 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5392079c-476a-48ad-83e9-888cc67ce94c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172] added
Nov 15 14:37:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b2e378-4891-4c1e-a039-3f56dcd91878]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cec904-8756-40ec-a390-7293c95eb4fd]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lorzRFBH {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lorzRFBH" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fa4cc5-8aa5-4623-925a-02642d1637c6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lorzRFBH'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b16d067-c1bc-4c5b-a603-5970df4d0ad8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[343a7095-0ebd-4108-84d9-5687d1fdf053]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:37:07 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:37:07 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:37:07 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 14:37:07 user nova-compute[74892]: 
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97fca32-d8e1-4b16-bed9-5894261a79dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172, portal: 172.16.0.220,3260]
Nov 15 14:37:07 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172, portal: 172.16.0.220,3260] successful.
Nov 15 14:37:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[517ffa9e-5769-4722-b517-e0fd22594785]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9856b5-1f6f-4915-b3f9-7180ce5bb3e9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:37:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:37:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:37:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef835e1-1462-48df-b1b1-35daaab3ed83]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:37:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lorzRFBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23238396237333062', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238396237333062', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'flavor' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:37:09 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:37:09 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:37:09 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:37:09 user nova-compute[74892]:   <serial>5d7e496e-f8ca-4925-89d4-bb683e3b4172</serial>
Nov 15 14:37:09 user nova-compute[74892]: </disk>
Nov 15 14:37:09 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No VIF found with MAC fa:16:3e:5a:18:91, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:37:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3fa64ed0-66a4-4e97-90da-82c55609f3fd tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.656s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:10 user nova-compute[74892]: INFO nova.compute.manager [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Rescuing
Nov 15 14:37:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:37:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquired lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:37:10 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Releasing lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-266aec1f-a93d-4caf-bcdf-a233aa323dc9 req-67ac4f17-69f5-4db8-b5fb-fb0782da8446 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-266aec1f-a93d-4caf-bcdf-a233aa323dc9 req-67ac4f17-69f5-4db8-b5fb-fb0782da8446 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-266aec1f-a93d-4caf-bcdf-a233aa323dc9 req-67ac4f17-69f5-4db8-b5fb-fb0782da8446 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-266aec1f-a93d-4caf-bcdf-a233aa323dc9 req-67ac4f17-69f5-4db8-b5fb-fb0782da8446 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-266aec1f-a93d-4caf-bcdf-a233aa323dc9 req-67ac4f17-69f5-4db8-b5fb-fb0782da8446 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:37:11 user nova-compute[74892]: WARNING nova.compute.manager [req-266aec1f-a93d-4caf-bcdf-a233aa323dc9 req-67ac4f17-69f5-4db8-b5fb-fb0782da8446 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state active and task_state rescuing.
Nov 15 14:37:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance destroyed successfully.
Nov 15 14:37:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Attempting rescue
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74892) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance directory exists: not creating {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 14:37:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Creating image(s)
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.050s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue" returned: 0 in 0.101s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'migration_context' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.base [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9ae2fc25-ebaf-4ec6-aa39-024abc893e3d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Start _get_guest_xml network_info=[{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:5a:18:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'resources' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.base [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9ae2fc25-ebaf-4ec6-aa39-024abc893e3d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.base [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9ae2fc25-ebaf-4ec6-aa39-024abc893e3d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:37:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:37:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.base [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9ae2fc25-ebaf-4ec6-aa39-024abc893e3d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1548300691',display_name='tempest-ServerRescueNegativeTestJSON-server-1548300691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1548300691',id=41,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZK0hMshfQI1nStccFJqSEJ4xCSBNif9T2xOmcZn+l9xds2ajFEa1z4u685xKg8EvnnI27QJwutQJETIhwGdLFJefb+qriPiiEmFaBnvjjARzi/805grNEMOLd8aE8MQ==',key_name='tempest-keypair-1639010971',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:35:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-61x2097t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:35:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=9ae2fc25-ebaf-4ec6-aa39-024abc893e3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:5a:18:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "vif_mac": "fa:16:3e:5a:18:91"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:18:91,bridge_name='br-int',has_traffic_filtering=True,id=1932b387-4572-4580-a391-7f2a5791bf60,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932b387-45') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.objects.base [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Object Instance<9ae2fc25-ebaf-4ec6-aa39-024abc893e3d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:37:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:37:12 user nova-compute[74892]:   <uuid>9ae2fc25-ebaf-4ec6-aa39-024abc893e3d</uuid>
Nov 15 14:37:12 user nova-compute[74892]:   <name>instance-00000029</name>
Nov 15 14:37:12 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:37:12 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:37:12 user nova-compute[74892]:   <metadata>
Nov 15 14:37:12 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:37:12 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:37:12 user nova-compute[74892]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1548300691</nova:name>
Nov 15 14:37:12 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:37:12</nova:creationTime>
Nov 15 14:37:12 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:37:12 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:37:12 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:37:12 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:37:12 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:37:12 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:37:12 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:37:12 user nova-compute[74892]:       <nova:owner>
Nov 15 14:37:12 user nova-compute[74892]:         <nova:user uuid="29fa0ea399dc4bafb5d2926ae76261c3">tempest-ServerRescueNegativeTestJSON-454831858-project-member</nova:user>
Nov 15 14:37:12 user nova-compute[74892]:         <nova:project uuid="16fe2666f7194df390f9764790c3663d">tempest-ServerRescueNegativeTestJSON-454831858</nova:project>
Nov 15 14:37:12 user nova-compute[74892]:       </nova:owner>
Nov 15 14:37:12 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:37:12 user nova-compute[74892]:       <nova:ports>
Nov 15 14:37:12 user nova-compute[74892]:         <nova:port uuid="1932b387-4572-4580-a391-7f2a5791bf60">
Nov 15 14:37:12 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:37:12 user nova-compute[74892]:         </nova:port>
Nov 15 14:37:12 user nova-compute[74892]:       </nova:ports>
Nov 15 14:37:12 user nova-compute[74892]:     </nova:instance>
Nov 15 14:37:12 user nova-compute[74892]:   </metadata>
Nov 15 14:37:12 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:37:12 user nova-compute[74892]:     <system>
Nov 15 14:37:12 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:37:12 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:37:12 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:37:12 user nova-compute[74892]:       <entry name="serial">9ae2fc25-ebaf-4ec6-aa39-024abc893e3d</entry>
Nov 15 14:37:12 user nova-compute[74892]:       <entry name="uuid">9ae2fc25-ebaf-4ec6-aa39-024abc893e3d</entry>
Nov 15 14:37:12 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:37:12 user nova-compute[74892]:     </system>
Nov 15 14:37:12 user nova-compute[74892]:   </sysinfo>
Nov 15 14:37:12 user nova-compute[74892]:   <os>
Nov 15 14:37:12 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:37:12 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:37:12 user nova-compute[74892]:   </os>
Nov 15 14:37:12 user nova-compute[74892]:   <features>
Nov 15 14:37:12 user nova-compute[74892]:     <acpi/>
Nov 15 14:37:12 user nova-compute[74892]:     <apic/>
Nov 15 14:37:12 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:37:12 user nova-compute[74892]:   </features>
Nov 15 14:37:12 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:37:12 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:37:12 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:37:12 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:37:12 user nova-compute[74892]:   </clock>
Nov 15 14:37:12 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:37:12 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:37:12 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:37:12 user nova-compute[74892]:   </cpu>
Nov 15 14:37:12 user nova-compute[74892]:   <devices>
Nov 15 14:37:12 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:37:12 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:37:12 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue"/>
Nov 15 14:37:12 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:37:12 user nova-compute[74892]:     </disk>
Nov 15 14:37:12 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:37:12 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:37:12 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk"/>
Nov 15 14:37:12 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:37:12 user nova-compute[74892]:     </disk>
Nov 15 14:37:12 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:37:12 user nova-compute[74892]:       <mac address="fa:16:3e:5a:18:91"/>
Nov 15 14:37:12 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:37:12 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:37:12 user nova-compute[74892]:       <target dev="tap1932b387-45"/>
Nov 15 14:37:12 user nova-compute[74892]:     </interface>
Nov 15 14:37:12 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:37:12 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/console.log" append="off"/>
Nov 15 14:37:12 user nova-compute[74892]:     </serial>
Nov 15 14:37:12 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:37:12 user nova-compute[74892]:     <video>
Nov 15 14:37:12 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:37:12 user nova-compute[74892]:     </video>
Nov 15 14:37:12 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:37:12 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:37:12 user nova-compute[74892]:     </rng>
Nov 15 14:37:12 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:37:12 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:37:12 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:37:12 user nova-compute[74892]:     </memballoon>
Nov 15 14:37:12 user nova-compute[74892]:   </devices>
Nov 15 14:37:12 user nova-compute[74892]: </domain>
Nov 15 14:37:12 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:37:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance destroyed successfully.
Nov 15 14:37:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:37:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:37:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] No VIF found with MAC fa:16:3e:5a:18:91, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:37:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-18f17534-60ea-414a-937d-383c28e911f5 req-b34acc22-151c-4b83-bf66-7dcd44cfc847 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-18f17534-60ea-414a-937d-383c28e911f5 req-b34acc22-151c-4b83-bf66-7dcd44cfc847 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-18f17534-60ea-414a-937d-383c28e911f5 req-b34acc22-151c-4b83-bf66-7dcd44cfc847 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-18f17534-60ea-414a-937d-383c28e911f5 req-b34acc22-151c-4b83-bf66-7dcd44cfc847 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-18f17534-60ea-414a-937d-383c28e911f5 req-b34acc22-151c-4b83-bf66-7dcd44cfc847 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:37:13 user nova-compute[74892]: WARNING nova.compute.manager [req-18f17534-60ea-414a-937d-383c28e911f5 req-b34acc22-151c-4b83-bf66-7dcd44cfc847 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state active and task_state rescuing.
Nov 15 14:37:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:37:15 user nova-compute[74892]: WARNING nova.compute.manager [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state active and task_state rescuing.
Nov 15 14:37:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:37:15 user nova-compute[74892]: WARNING nova.compute.manager [req-2fc037af-87c7-48f7-be9a-bfd1c8613d19 req-8f0b4b74-ad12-41f8-b963-9437a4c9ad47 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state active and task_state rescuing.
Nov 15 14:37:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-bd3d2dbf-6ca4-4189-bbeb-f7bf9fdfe437 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:37:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "87e2190a-c0eb-49da-a757-98a9175946e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "87e2190a-c0eb-49da-a757-98a9175946e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:37:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:21 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:37:21 user nova-compute[74892]: INFO nova.compute.claims [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Claim successful on node user
Nov 15 14:37:22 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:37:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:37:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:37:22 user nova-compute[74892]: INFO nova.virt.block_device [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Booting with volume ccb8a2b6-6730-43f4-bb8c-2e30855404a9 at /dev/vda
Nov 15 14:37:22 user nova-compute[74892]: DEBUG nova.policy [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c73da782783d41dbb370c3df04dec208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdd6323d06f4337995cbb796778b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG os_brick.utils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1a5fd5-0607-40b2-98d1-68512e8ffe17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c178c404-c735-4ba7-906a-3a2408678bbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e436db-2f59-4579-bfa4-da5463e01a5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6ceba9-9c5c-4c1c-8681-1dd67d975bb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:37:22 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:37:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b374d077-1f52-439a-85ba-9fa863f56399]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG os_brick.utils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:37:22 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Updating existing volume attachment record: 8da66f22-3b7e-40b0-b791-e281c5851314 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Successfully created port: f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Successfully updated port: f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquired lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d8beb97-9b11-414b-8b0f-336c7269a77a req-ee3940ab-64a1-4e25-81fb-ddbfcff946ab service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received event network-changed-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-2d8beb97-9b11-414b-8b0f-336c7269a77a req-ee3940ab-64a1-4e25-81fb-ddbfcff946ab service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Refreshing instance network info cache due to event network-changed-f252a817-3ef0-431d-bece-40581512b9e2. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d8beb97-9b11-414b-8b0f-336c7269a77a req-ee3940ab-64a1-4e25-81fb-ddbfcff946ab service nova] Acquiring lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:37:23 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:37:24 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Updating instance_info_cache with network_info: [{"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:37:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Releasing lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:37:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Instance network_info: |[{"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:37:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d8beb97-9b11-414b-8b0f-336c7269a77a req-ee3940ab-64a1-4e25-81fb-ddbfcff946ab service nova] Acquired lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:37:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-2d8beb97-9b11-414b-8b0f-336c7269a77a req-ee3940ab-64a1-4e25-81fb-ddbfcff946ab service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Refreshing network info cache for port f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:37:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-2d8beb97-9b11-414b-8b0f-336c7269a77a req-ee3940ab-64a1-4e25-81fb-ddbfcff946ab service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Updated VIF entry in instance network info cache for port f252a817-3ef0-431d-bece-40581512b9e2. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:37:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-2d8beb97-9b11-414b-8b0f-336c7269a77a req-ee3940ab-64a1-4e25-81fb-ddbfcff946ab service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Updating instance_info_cache with network_info: [{"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:37:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2d8beb97-9b11-414b-8b0f-336c7269a77a req-ee3940ab-64a1-4e25-81fb-ddbfcff946ab service nova] Releasing lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:37:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:37:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Creating image(s)
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Ensure instance console log exists: /opt/stack/data/nova/instances/87e2190a-c0eb-49da-a757-98a9175946e6/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Start _get_guest_xml network_info=[{"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRgGkCDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87e2190a-c0eb-49da-a757-98a9175946e6', 'attached_at': '', 'detached_at': '', 'volume_id': 'ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'serial': 'ccb8a2b6-6730-43f4-bb8c-2e30855404a9'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '8da66f22-3b7e-40b0-b791-e281c5851314', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:37:28 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:37:28 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRgGkCDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:37:28 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:37:28 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:37:28 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[61382e6d-efc8-4dcd-b519-0a984a493155]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:37:28 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acb9fc4-40f3-4cc0-a44f-206737eadf1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9] added
Nov 15 14:37:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc54ed49-f658-475d-9d06-36b8fd12c29e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ef8baf-a0db-4972-b2e4-7f92e91492de]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRgGkCDi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRgGkCDi" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a711e0b-92c1-43e3-b777-c743d2e2e6d7]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRgGkCDi'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[21278223-b3f3-4451-8716-fa0605812cef]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f55c25-f87d-4199-85e5-f86977f4f7fc]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:37:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:37:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[26954490-25f5-40df-96fe-5ff777f97f90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260]
Nov 15 14:37:28 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260] successful.
Nov 15 14:37:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16be6a-cb06-4555-93ef-1a6edb8dc2af]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cd0d30-0236-4693-86e4-2183017d6f3c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:37:28 user nova-compute[74892]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:37:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:37:28 user nova-compute[74892]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:37:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e68937-9c64-4bdc-b959-4026bbe3dad2]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:37:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRgGkCDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26139626430643731', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139626430643731', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-358697145',display_name='tempest-TestVolumeBootPattern-server-358697145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-358697145',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-rpi0wl12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:37:22Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=87e2190a-c0eb-49da-a757-98a9175946e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:45:d1,bridge_name='br-int',has_traffic_filtering=True,id=f252a817-3ef0-431d-bece-40581512b9e2,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf252a817-3e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.objects.instance [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'pci_devices' on Instance uuid 87e2190a-c0eb-49da-a757-98a9175946e6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:37:29 user nova-compute[74892]:   <uuid>87e2190a-c0eb-49da-a757-98a9175946e6</uuid>
Nov 15 14:37:29 user nova-compute[74892]:   <name>instance-0000002b</name>
Nov 15 14:37:29 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:37:29 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:37:29 user nova-compute[74892]:   <metadata>
Nov 15 14:37:29 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:37:29 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:37:29 user nova-compute[74892]:       <nova:name>tempest-TestVolumeBootPattern-server-358697145</nova:name>
Nov 15 14:37:29 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:37:28</nova:creationTime>
Nov 15 14:37:29 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:37:29 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:37:29 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:37:29 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:37:29 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:37:29 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:37:29 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:37:29 user nova-compute[74892]:       <nova:owner>
Nov 15 14:37:29 user nova-compute[74892]:         <nova:user uuid="c73da782783d41dbb370c3df04dec208">tempest-TestVolumeBootPattern-1799633332-project-member</nova:user>
Nov 15 14:37:29 user nova-compute[74892]:         <nova:project uuid="1cdd6323d06f4337995cbb796778b449">tempest-TestVolumeBootPattern-1799633332</nova:project>
Nov 15 14:37:29 user nova-compute[74892]:       </nova:owner>
Nov 15 14:37:29 user nova-compute[74892]:       <nova:ports>
Nov 15 14:37:29 user nova-compute[74892]:         <nova:port uuid="f252a817-3ef0-431d-bece-40581512b9e2">
Nov 15 14:37:29 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:37:29 user nova-compute[74892]:         </nova:port>
Nov 15 14:37:29 user nova-compute[74892]:       </nova:ports>
Nov 15 14:37:29 user nova-compute[74892]:     </nova:instance>
Nov 15 14:37:29 user nova-compute[74892]:   </metadata>
Nov 15 14:37:29 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:37:29 user nova-compute[74892]:     <system>
Nov 15 14:37:29 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:37:29 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:37:29 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:37:29 user nova-compute[74892]:       <entry name="serial">87e2190a-c0eb-49da-a757-98a9175946e6</entry>
Nov 15 14:37:29 user nova-compute[74892]:       <entry name="uuid">87e2190a-c0eb-49da-a757-98a9175946e6</entry>
Nov 15 14:37:29 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:37:29 user nova-compute[74892]:     </system>
Nov 15 14:37:29 user nova-compute[74892]:   </sysinfo>
Nov 15 14:37:29 user nova-compute[74892]:   <os>
Nov 15 14:37:29 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:37:29 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:37:29 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:37:29 user nova-compute[74892]:   </os>
Nov 15 14:37:29 user nova-compute[74892]:   <features>
Nov 15 14:37:29 user nova-compute[74892]:     <acpi/>
Nov 15 14:37:29 user nova-compute[74892]:     <apic/>
Nov 15 14:37:29 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:37:29 user nova-compute[74892]:   </features>
Nov 15 14:37:29 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:37:29 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:37:29 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:37:29 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:37:29 user nova-compute[74892]:   </clock>
Nov 15 14:37:29 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:37:29 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:37:29 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:37:29 user nova-compute[74892]:   </cpu>
Nov 15 14:37:29 user nova-compute[74892]:   <devices>
Nov 15 14:37:29 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:37:29 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:37:29 user nova-compute[74892]:       <source dev="/dev/sdc"/>
Nov 15 14:37:29 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:37:29 user nova-compute[74892]:       <serial>ccb8a2b6-6730-43f4-bb8c-2e30855404a9</serial>
Nov 15 14:37:29 user nova-compute[74892]:     </disk>
Nov 15 14:37:29 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:37:29 user nova-compute[74892]:       <mac address="fa:16:3e:6e:45:d1"/>
Nov 15 14:37:29 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:37:29 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:37:29 user nova-compute[74892]:       <target dev="tapf252a817-3e"/>
Nov 15 14:37:29 user nova-compute[74892]:     </interface>
Nov 15 14:37:29 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:37:29 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/87e2190a-c0eb-49da-a757-98a9175946e6/console.log" append="off"/>
Nov 15 14:37:29 user nova-compute[74892]:     </serial>
Nov 15 14:37:29 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:37:29 user nova-compute[74892]:     <video>
Nov 15 14:37:29 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:37:29 user nova-compute[74892]:     </video>
Nov 15 14:37:29 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:37:29 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:37:29 user nova-compute[74892]:     </rng>
Nov 15 14:37:29 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:37:29 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:37:29 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:37:29 user nova-compute[74892]:     </memballoon>
Nov 15 14:37:29 user nova-compute[74892]:   </devices>
Nov 15 14:37:29 user nova-compute[74892]: </domain>
Nov 15 14:37:29 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-358697145',display_name='tempest-TestVolumeBootPattern-server-358697145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-358697145',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-rpi0wl12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:37:22Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=87e2190a-c0eb-49da-a757-98a9175946e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:45:d1,bridge_name='br-int',has_traffic_filtering=True,id=f252a817-3ef0-431d-bece-40581512b9e2,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf252a817-3e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG os_vif [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:45:d1,bridge_name='br-int',has_traffic_filtering=True,id=f252a817-3ef0-431d-bece-40581512b9e2,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf252a817-3e') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5db2c3d-9869-539b-bb6e-ac4034605600', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf252a817-3e, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf252a817-3e, col_values=(('qos', UUID('c3cbc1b4-da7d-4337-ba4a-b560c1695a12')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf252a817-3e, col_values=(('external_ids', {'iface-id': 'f252a817-3ef0-431d-bece-40581512b9e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:45:d1', 'vm-uuid': '87e2190a-c0eb-49da-a757-98a9175946e6'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:29 user nova-compute[74892]: INFO os_vif [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:45:d1,bridge_name='br-int',has_traffic_filtering=True,id=f252a817-3ef0-431d-bece-40581512b9e2,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf252a817-3e')
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:37:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No VIF found with MAC fa:16:3e:6e:45:d1, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:37:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-498c25c6-6ef3-464e-9aae-1c317d013684 req-696caf7f-e427-46ac-aec0-6d7510dd670a service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received event network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-498c25c6-6ef3-464e-9aae-1c317d013684 req-696caf7f-e427-46ac-aec0-6d7510dd670a service nova] Acquiring lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-498c25c6-6ef3-464e-9aae-1c317d013684 req-696caf7f-e427-46ac-aec0-6d7510dd670a service nova] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-498c25c6-6ef3-464e-9aae-1c317d013684 req-696caf7f-e427-46ac-aec0-6d7510dd670a service nova] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-498c25c6-6ef3-464e-9aae-1c317d013684 req-696caf7f-e427-46ac-aec0-6d7510dd670a service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] No waiting events found dispatching network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:37:31 user nova-compute[74892]: WARNING nova.compute.manager [req-498c25c6-6ef3-464e-9aae-1c317d013684 req-696caf7f-e427-46ac-aec0-6d7510dd670a service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received unexpected event network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 for instance with vm_state building and task_state spawning.
Nov 15 14:37:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:37:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Instance spawned successfully.
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:37:33 user nova-compute[74892]: INFO nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Took 5.15 seconds to spawn the instance on the hypervisor.
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-8e716c71-1880-4f4c-ac5c-3e3fc2d73752 req-8f08bc0a-1a60-4ce4-9720-7d81eec2ac1d service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received event network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8e716c71-1880-4f4c-ac5c-3e3fc2d73752 req-8f08bc0a-1a60-4ce4-9720-7d81eec2ac1d service nova] Acquiring lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8e716c71-1880-4f4c-ac5c-3e3fc2d73752 req-8f08bc0a-1a60-4ce4-9720-7d81eec2ac1d service nova] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8e716c71-1880-4f4c-ac5c-3e3fc2d73752 req-8f08bc0a-1a60-4ce4-9720-7d81eec2ac1d service nova] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-8e716c71-1880-4f4c-ac5c-3e3fc2d73752 req-8f08bc0a-1a60-4ce4-9720-7d81eec2ac1d service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] No waiting events found dispatching network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:37:33 user nova-compute[74892]: WARNING nova.compute.manager [req-8e716c71-1880-4f4c-ac5c-3e3fc2d73752 req-8f08bc0a-1a60-4ce4-9720-7d81eec2ac1d service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received unexpected event network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 for instance with vm_state building and task_state spawning.
Nov 15 14:37:33 user nova-compute[74892]: INFO nova.compute.manager [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Took 11.73 seconds to build instance.
Nov 15 14:37:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16f34113-bfc1-4d53-882d-b2bdb94e4b9e tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "87e2190a-c0eb-49da-a757-98a9175946e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.848s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:37:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.369s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:57 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:37:57 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8279MB free_disk=25.101898193359375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 87e2190a-c0eb-49da-a757-98a9175946e6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:37:58 user nova-compute[74892]: INFO nova.compute.claims [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Claim successful on node user
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:37:58 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.policy [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66f5d0ae0aeb4fac9c5c772544a74ee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec117ead6994cf4a27a81d82f1d7fc0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:37:58 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Creating image(s)
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "/opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "/opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk 1073741824" returned: 0 in 0.052s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Successfully created port: 500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Cannot resize image /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Ensure instance console log exists: /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updating instance_info_cache with network_info: [{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Successfully updated port: 500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquired lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-c2bdc1cd-0930-45c7-b1fc-a5a49621112b req-9a853c85-0e7d-4d01-81de-6175b83db50f service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-changed-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.compute.manager [req-c2bdc1cd-0930-45c7-b1fc-a5a49621112b req-9a853c85-0e7d-4d01-81de-6175b83db50f service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Refreshing instance network info cache due to event network-changed-500820b5-a335-4501-ab44-3d994600fc78. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c2bdc1cd-0930-45c7-b1fc-a5a49621112b req-9a853c85-0e7d-4d01-81de-6175b83db50f service nova] Acquiring lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:37:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating instance_info_cache with network_info: [{"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Releasing lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Instance network_info: |[{"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c2bdc1cd-0930-45c7-b1fc-a5a49621112b req-9a853c85-0e7d-4d01-81de-6175b83db50f service nova] Acquired lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.network.neutron [req-c2bdc1cd-0930-45c7-b1fc-a5a49621112b req-9a853c85-0e7d-4d01-81de-6175b83db50f service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Refreshing network info cache for port 500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Start _get_guest_xml network_info=[{"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:38:00 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:38:00 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-944248390',display_name='tempest-SnapshotDataIntegrityTests-server-944248390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-944248390',id=44,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaNdWPd832yLSermuaruSQ9iUPnZIRASThpR3M/6RK2pzalwpGDzJ+O0LAXra9zoMrgzrzUPGaQUlXxE8QIUHcOHrVxBs9RPtF6OS2+/KW03QPptIXWOO6D7h302yIDyA==',key_name='tempest-keypair-579133522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ec117ead6994cf4a27a81d82f1d7fc0',ramdisk_id='',reservation_id='r-8bhohghf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1644407710',owner_user_name='tempest-SnapshotDataIntegrityTests-1644407710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66f5d0ae0aeb4fac9c5c772544a74ee5',uuid=3d2b2ed9-7627-4d26-a696-ce7a18e2f402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Converting VIF {"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1e:14,bridge_name='br-int',has_traffic_filtering=True,id=500820b5-a335-4501-ab44-3d994600fc78,network=Network(26fa38e4-fab3-42d4-b63e-1a5f24aa5045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500820b5-a3') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:38:00 user nova-compute[74892]:   <uuid>3d2b2ed9-7627-4d26-a696-ce7a18e2f402</uuid>
Nov 15 14:38:00 user nova-compute[74892]:   <name>instance-0000002c</name>
Nov 15 14:38:00 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:38:00 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:38:00 user nova-compute[74892]:   <metadata>
Nov 15 14:38:00 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:38:00 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:38:00 user nova-compute[74892]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-944248390</nova:name>
Nov 15 14:38:00 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:38:00</nova:creationTime>
Nov 15 14:38:00 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:38:00 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:38:00 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:38:00 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:38:00 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:38:00 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:38:00 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:38:00 user nova-compute[74892]:       <nova:owner>
Nov 15 14:38:00 user nova-compute[74892]:         <nova:user uuid="66f5d0ae0aeb4fac9c5c772544a74ee5">tempest-SnapshotDataIntegrityTests-1644407710-project-member</nova:user>
Nov 15 14:38:00 user nova-compute[74892]:         <nova:project uuid="6ec117ead6994cf4a27a81d82f1d7fc0">tempest-SnapshotDataIntegrityTests-1644407710</nova:project>
Nov 15 14:38:00 user nova-compute[74892]:       </nova:owner>
Nov 15 14:38:00 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:38:00 user nova-compute[74892]:       <nova:ports>
Nov 15 14:38:00 user nova-compute[74892]:         <nova:port uuid="500820b5-a335-4501-ab44-3d994600fc78">
Nov 15 14:38:00 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 14:38:00 user nova-compute[74892]:         </nova:port>
Nov 15 14:38:00 user nova-compute[74892]:       </nova:ports>
Nov 15 14:38:00 user nova-compute[74892]:     </nova:instance>
Nov 15 14:38:00 user nova-compute[74892]:   </metadata>
Nov 15 14:38:00 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:38:00 user nova-compute[74892]:     <system>
Nov 15 14:38:00 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:38:00 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:38:00 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:38:00 user nova-compute[74892]:       <entry name="serial">3d2b2ed9-7627-4d26-a696-ce7a18e2f402</entry>
Nov 15 14:38:00 user nova-compute[74892]:       <entry name="uuid">3d2b2ed9-7627-4d26-a696-ce7a18e2f402</entry>
Nov 15 14:38:00 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:38:00 user nova-compute[74892]:     </system>
Nov 15 14:38:00 user nova-compute[74892]:   </sysinfo>
Nov 15 14:38:00 user nova-compute[74892]:   <os>
Nov 15 14:38:00 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:38:00 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:38:00 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:38:00 user nova-compute[74892]:   </os>
Nov 15 14:38:00 user nova-compute[74892]:   <features>
Nov 15 14:38:00 user nova-compute[74892]:     <acpi/>
Nov 15 14:38:00 user nova-compute[74892]:     <apic/>
Nov 15 14:38:00 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:38:00 user nova-compute[74892]:   </features>
Nov 15 14:38:00 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:38:00 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:38:00 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:38:00 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:38:00 user nova-compute[74892]:   </clock>
Nov 15 14:38:00 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:38:00 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:38:00 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:38:00 user nova-compute[74892]:   </cpu>
Nov 15 14:38:00 user nova-compute[74892]:   <devices>
Nov 15 14:38:00 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:38:00 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:38:00 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk"/>
Nov 15 14:38:00 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:38:00 user nova-compute[74892]:     </disk>
Nov 15 14:38:00 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:38:00 user nova-compute[74892]:       <mac address="fa:16:3e:cd:1e:14"/>
Nov 15 14:38:00 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:38:00 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:38:00 user nova-compute[74892]:       <target dev="tap500820b5-a3"/>
Nov 15 14:38:00 user nova-compute[74892]:     </interface>
Nov 15 14:38:00 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:38:00 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/console.log" append="off"/>
Nov 15 14:38:00 user nova-compute[74892]:     </serial>
Nov 15 14:38:00 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:38:00 user nova-compute[74892]:     <video>
Nov 15 14:38:00 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:38:00 user nova-compute[74892]:     </video>
Nov 15 14:38:00 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:38:00 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:38:00 user nova-compute[74892]:     </rng>
Nov 15 14:38:00 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:38:00 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:38:00 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:38:00 user nova-compute[74892]:     </memballoon>
Nov 15 14:38:00 user nova-compute[74892]:   </devices>
Nov 15 14:38:00 user nova-compute[74892]: </domain>
Nov 15 14:38:00 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-944248390',display_name='tempest-SnapshotDataIntegrityTests-server-944248390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-944248390',id=44,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaNdWPd832yLSermuaruSQ9iUPnZIRASThpR3M/6RK2pzalwpGDzJ+O0LAXra9zoMrgzrzUPGaQUlXxE8QIUHcOHrVxBs9RPtF6OS2+/KW03QPptIXWOO6D7h302yIDyA==',key_name='tempest-keypair-579133522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ec117ead6994cf4a27a81d82f1d7fc0',ramdisk_id='',reservation_id='r-8bhohghf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1644407710',owner_user_name='tempest-SnapshotDataIntegrityTests-1644407710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66f5d0ae0aeb4fac9c5c772544a74ee5',uuid=3d2b2ed9-7627-4d26-a696-ce7a18e2f402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Converting VIF {"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1e:14,bridge_name='br-int',has_traffic_filtering=True,id=500820b5-a335-4501-ab44-3d994600fc78,network=Network(26fa38e4-fab3-42d4-b63e-1a5f24aa5045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500820b5-a3') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG os_vif [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1e:14,bridge_name='br-int',has_traffic_filtering=True,id=500820b5-a335-4501-ab44-3d994600fc78,network=Network(26fa38e4-fab3-42d4-b63e-1a5f24aa5045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500820b5-a3') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e29ff2e-c81b-5474-afaa-bb1220074d72', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap500820b5-a3, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap500820b5-a3, col_values=(('qos', UUID('45c4f64c-2377-4ddf-a1f9-0cd96082c6b2')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap500820b5-a3, col_values=(('external_ids', {'iface-id': '500820b5-a335-4501-ab44-3d994600fc78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:1e:14', 'vm-uuid': '3d2b2ed9-7627-4d26-a696-ce7a18e2f402'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:00 user nova-compute[74892]: INFO os_vif [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1e:14,bridge_name='br-int',has_traffic_filtering=True,id=500820b5-a335-4501-ab44-3d994600fc78,network=Network(26fa38e4-fab3-42d4-b63e-1a5f24aa5045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500820b5-a3')
Nov 15 14:38:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No VIF found with MAC fa:16:3e:cd:1e:14, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.network.neutron [req-c2bdc1cd-0930-45c7-b1fc-a5a49621112b req-9a853c85-0e7d-4d01-81de-6175b83db50f service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updated VIF entry in instance network info cache for port 500820b5-a335-4501-ab44-3d994600fc78. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG nova.network.neutron [req-c2bdc1cd-0930-45c7-b1fc-a5a49621112b req-9a853c85-0e7d-4d01-81de-6175b83db50f service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating instance_info_cache with network_info: [{"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c2bdc1cd-0930-45c7-b1fc-a5a49621112b req-9a853c85-0e7d-4d01-81de-6175b83db50f service nova] Releasing lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:38:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:01 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:01 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-5b8e5d19-5281-4f50-9b1e-968b7dabd85d req-9ffd20b1-e385-47a8-971b-845369eb447f service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5b8e5d19-5281-4f50-9b1e-968b7dabd85d req-9ffd20b1-e385-47a8-971b-845369eb447f service nova] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5b8e5d19-5281-4f50-9b1e-968b7dabd85d req-9ffd20b1-e385-47a8-971b-845369eb447f service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5b8e5d19-5281-4f50-9b1e-968b7dabd85d req-9ffd20b1-e385-47a8-971b-845369eb447f service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG nova.compute.manager [req-5b8e5d19-5281-4f50-9b1e-968b7dabd85d req-9ffd20b1-e385-47a8-971b-845369eb447f service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] No waiting events found dispatching network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:38:02 user nova-compute[74892]: WARNING nova.compute.manager [req-5b8e5d19-5281-4f50-9b1e-968b7dabd85d req-9ffd20b1-e385-47a8-971b-845369eb447f service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received unexpected event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 for instance with vm_state building and task_state spawning.
Nov 15 14:38:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:38:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Instance spawned successfully.
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:03 user nova-compute[74892]: INFO nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 15 14:38:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:38:04 user nova-compute[74892]: INFO nova.compute.manager [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Took 5.99 seconds to build instance.
Nov 15 14:38:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-554149be-7905-41aa-b094-1b2c8ad6ea6b req-aba37494-85e0-4730-acfd-332bb14207d8 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:38:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-554149be-7905-41aa-b094-1b2c8ad6ea6b req-aba37494-85e0-4730-acfd-332bb14207d8 service nova] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-554149be-7905-41aa-b094-1b2c8ad6ea6b req-aba37494-85e0-4730-acfd-332bb14207d8 service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-554149be-7905-41aa-b094-1b2c8ad6ea6b req-aba37494-85e0-4730-acfd-332bb14207d8 service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-554149be-7905-41aa-b094-1b2c8ad6ea6b req-aba37494-85e0-4730-acfd-332bb14207d8 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] No waiting events found dispatching network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:38:04 user nova-compute[74892]: WARNING nova.compute.manager [req-554149be-7905-41aa-b094-1b2c8ad6ea6b req-aba37494-85e0-4730-acfd-332bb14207d8 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received unexpected event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 for instance with vm_state active and task_state None.
Nov 15 14:38:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a33c3f7a-ced6-4666-a23d-1f089f38f5b4 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.088s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:38:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:38:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:38:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:38:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:38:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:38:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:38:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "e3554958-4625-479b-88d1-c4d4d522234e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "e3554958-4625-479b-88d1-c4d4d522234e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:38:43 user nova-compute[74892]: INFO nova.compute.claims [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Claim successful on node user
Nov 15 14:38:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:38:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:38:44 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.policy [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0502e4587dbc404da26bf5929fe2e3de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8a34907a5846d68349968529f49dfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:38:44 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Creating image(s)
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "/opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "/opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.196s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk 1073741824" returned: 0 in 0.063s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Successfully created port: 5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Cannot resize image /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Ensure instance console log exists: /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Successfully updated port: 5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "refresh_cache-e3554958-4625-479b-88d1-c4d4d522234e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquired lock "refresh_cache-e3554958-4625-479b-88d1-c4d4d522234e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-b1fd3835-454b-4e19-98e0-6e6d05e69fe0 req-49a43cc0-0d0d-4e26-8d32-59f95fd2be0b service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received event network-changed-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-b1fd3835-454b-4e19-98e0-6e6d05e69fe0 req-49a43cc0-0d0d-4e26-8d32-59f95fd2be0b service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Refreshing instance network info cache due to event network-changed-5c9a89cb-556e-4371-9a90-6c5e73384ad5. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b1fd3835-454b-4e19-98e0-6e6d05e69fe0 req-49a43cc0-0d0d-4e26-8d32-59f95fd2be0b service nova] Acquiring lock "refresh_cache-e3554958-4625-479b-88d1-c4d4d522234e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.neutron [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Updating instance_info_cache with network_info: [{"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Releasing lock "refresh_cache-e3554958-4625-479b-88d1-c4d4d522234e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Instance network_info: |[{"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b1fd3835-454b-4e19-98e0-6e6d05e69fe0 req-49a43cc0-0d0d-4e26-8d32-59f95fd2be0b service nova] Acquired lock "refresh_cache-e3554958-4625-479b-88d1-c4d4d522234e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.neutron [req-b1fd3835-454b-4e19-98e0-6e6d05e69fe0 req-49a43cc0-0d0d-4e26-8d32-59f95fd2be0b service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Refreshing network info cache for port 5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Start _get_guest_xml network_info=[{"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:38:46 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:38:46 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1157653836',display_name='tempest-ServersNegativeTestJSON-server-1157653836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1157653836',id=45,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8a34907a5846d68349968529f49dfc',ramdisk_id='',reservation_id='r-pss0zgvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1366943078',owner_user_name='tempest-ServersNegativeTestJSON-1366943078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:38:44Z,user_data=None,user_id='0502e4587dbc404da26bf5929fe2e3de',uuid=e3554958-4625-479b-88d1-c4d4d522234e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converting VIF {"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:69:ff,bridge_name='br-int',has_traffic_filtering=True,id=5c9a89cb-556e-4371-9a90-6c5e73384ad5,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9a89cb-55') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.objects.instance [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lazy-loading 'pci_devices' on Instance uuid e3554958-4625-479b-88d1-c4d4d522234e {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:38:46 user nova-compute[74892]:   <uuid>e3554958-4625-479b-88d1-c4d4d522234e</uuid>
Nov 15 14:38:46 user nova-compute[74892]:   <name>instance-0000002d</name>
Nov 15 14:38:46 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:38:46 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:38:46 user nova-compute[74892]:   <metadata>
Nov 15 14:38:46 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:38:46 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:38:46 user nova-compute[74892]:       <nova:name>tempest-ServersNegativeTestJSON-server-1157653836</nova:name>
Nov 15 14:38:46 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:38:46</nova:creationTime>
Nov 15 14:38:46 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:38:46 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:38:46 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:38:46 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:38:46 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:38:46 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:38:46 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:38:46 user nova-compute[74892]:       <nova:owner>
Nov 15 14:38:46 user nova-compute[74892]:         <nova:user uuid="0502e4587dbc404da26bf5929fe2e3de">tempest-ServersNegativeTestJSON-1366943078-project-member</nova:user>
Nov 15 14:38:46 user nova-compute[74892]:         <nova:project uuid="5a8a34907a5846d68349968529f49dfc">tempest-ServersNegativeTestJSON-1366943078</nova:project>
Nov 15 14:38:46 user nova-compute[74892]:       </nova:owner>
Nov 15 14:38:46 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:38:46 user nova-compute[74892]:       <nova:ports>
Nov 15 14:38:46 user nova-compute[74892]:         <nova:port uuid="5c9a89cb-556e-4371-9a90-6c5e73384ad5">
Nov 15 14:38:46 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:38:46 user nova-compute[74892]:         </nova:port>
Nov 15 14:38:46 user nova-compute[74892]:       </nova:ports>
Nov 15 14:38:46 user nova-compute[74892]:     </nova:instance>
Nov 15 14:38:46 user nova-compute[74892]:   </metadata>
Nov 15 14:38:46 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:38:46 user nova-compute[74892]:     <system>
Nov 15 14:38:46 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:38:46 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:38:46 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:38:46 user nova-compute[74892]:       <entry name="serial">e3554958-4625-479b-88d1-c4d4d522234e</entry>
Nov 15 14:38:46 user nova-compute[74892]:       <entry name="uuid">e3554958-4625-479b-88d1-c4d4d522234e</entry>
Nov 15 14:38:46 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:38:46 user nova-compute[74892]:     </system>
Nov 15 14:38:46 user nova-compute[74892]:   </sysinfo>
Nov 15 14:38:46 user nova-compute[74892]:   <os>
Nov 15 14:38:46 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:38:46 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:38:46 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:38:46 user nova-compute[74892]:   </os>
Nov 15 14:38:46 user nova-compute[74892]:   <features>
Nov 15 14:38:46 user nova-compute[74892]:     <acpi/>
Nov 15 14:38:46 user nova-compute[74892]:     <apic/>
Nov 15 14:38:46 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:38:46 user nova-compute[74892]:   </features>
Nov 15 14:38:46 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:38:46 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:38:46 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:38:46 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:38:46 user nova-compute[74892]:   </clock>
Nov 15 14:38:46 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:38:46 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:38:46 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:38:46 user nova-compute[74892]:   </cpu>
Nov 15 14:38:46 user nova-compute[74892]:   <devices>
Nov 15 14:38:46 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:38:46 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:38:46 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk"/>
Nov 15 14:38:46 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:38:46 user nova-compute[74892]:     </disk>
Nov 15 14:38:46 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:38:46 user nova-compute[74892]:       <mac address="fa:16:3e:26:69:ff"/>
Nov 15 14:38:46 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:38:46 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:38:46 user nova-compute[74892]:       <target dev="tap5c9a89cb-55"/>
Nov 15 14:38:46 user nova-compute[74892]:     </interface>
Nov 15 14:38:46 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:38:46 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/console.log" append="off"/>
Nov 15 14:38:46 user nova-compute[74892]:     </serial>
Nov 15 14:38:46 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:38:46 user nova-compute[74892]:     <video>
Nov 15 14:38:46 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:38:46 user nova-compute[74892]:     </video>
Nov 15 14:38:46 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:38:46 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:38:46 user nova-compute[74892]:     </rng>
Nov 15 14:38:46 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:38:46 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:38:46 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:38:46 user nova-compute[74892]:     </memballoon>
Nov 15 14:38:46 user nova-compute[74892]:   </devices>
Nov 15 14:38:46 user nova-compute[74892]: </domain>
Nov 15 14:38:46 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1157653836',display_name='tempest-ServersNegativeTestJSON-server-1157653836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1157653836',id=45,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8a34907a5846d68349968529f49dfc',ramdisk_id='',reservation_id='r-pss0zgvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1366943078',owner_user_name='tempest-ServersNegativeTestJSON-1366943078-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:38:44Z,user_data=None,user_id='0502e4587dbc404da26bf5929fe2e3de',uuid=e3554958-4625-479b-88d1-c4d4d522234e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converting VIF {"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:69:ff,bridge_name='br-int',has_traffic_filtering=True,id=5c9a89cb-556e-4371-9a90-6c5e73384ad5,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9a89cb-55') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG os_vif [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:69:ff,bridge_name='br-int',has_traffic_filtering=True,id=5c9a89cb-556e-4371-9a90-6c5e73384ad5,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9a89cb-55') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '711bd16e-a804-5566-8348-74d91f7a7641', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c9a89cb-55, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c9a89cb-55, col_values=(('qos', UUID('b7c72e57-ca3d-40b6-814b-58e00c6bb2c2')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c9a89cb-55, col_values=(('external_ids', {'iface-id': '5c9a89cb-556e-4371-9a90-6c5e73384ad5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:69:ff', 'vm-uuid': 'e3554958-4625-479b-88d1-c4d4d522234e'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:46 user nova-compute[74892]: INFO os_vif [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:69:ff,bridge_name='br-int',has_traffic_filtering=True,id=5c9a89cb-556e-4371-9a90-6c5e73384ad5,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9a89cb-55')
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] No VIF found with MAC fa:16:3e:26:69:ff, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.neutron [req-b1fd3835-454b-4e19-98e0-6e6d05e69fe0 req-49a43cc0-0d0d-4e26-8d32-59f95fd2be0b service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Updated VIF entry in instance network info cache for port 5c9a89cb-556e-4371-9a90-6c5e73384ad5. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG nova.network.neutron [req-b1fd3835-454b-4e19-98e0-6e6d05e69fe0 req-49a43cc0-0d0d-4e26-8d32-59f95fd2be0b service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Updating instance_info_cache with network_info: [{"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:38:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b1fd3835-454b-4e19-98e0-6e6d05e69fe0 req-49a43cc0-0d0d-4e26-8d32-59f95fd2be0b service nova] Releasing lock "refresh_cache-e3554958-4625-479b-88d1-c4d4d522234e" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:38:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-88ebf7ca-4455-42f2-a2cb-12c2ac85af3e req-eed37fdc-0149-448a-b9b7-e4f3c5364f7a service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received event network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:38:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-88ebf7ca-4455-42f2-a2cb-12c2ac85af3e req-eed37fdc-0149-448a-b9b7-e4f3c5364f7a service nova] Acquiring lock "e3554958-4625-479b-88d1-c4d4d522234e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-88ebf7ca-4455-42f2-a2cb-12c2ac85af3e req-eed37fdc-0149-448a-b9b7-e4f3c5364f7a service nova] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-88ebf7ca-4455-42f2-a2cb-12c2ac85af3e req-eed37fdc-0149-448a-b9b7-e4f3c5364f7a service nova] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-88ebf7ca-4455-42f2-a2cb-12c2ac85af3e req-eed37fdc-0149-448a-b9b7-e4f3c5364f7a service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] No waiting events found dispatching network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:38:48 user nova-compute[74892]: WARNING nova.compute.manager [req-88ebf7ca-4455-42f2-a2cb-12c2ac85af3e req-eed37fdc-0149-448a-b9b7-e4f3c5364f7a service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received unexpected event network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 for instance with vm_state building and task_state spawning.
Nov 15 14:38:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-02bcd51f-02b9-4d28-be3f-c0b3ea8aff46 req-16da9e42-2687-47a0-bc9b-2c1aefb8c0d2 service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received event network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02bcd51f-02b9-4d28-be3f-c0b3ea8aff46 req-16da9e42-2687-47a0-bc9b-2c1aefb8c0d2 service nova] Acquiring lock "e3554958-4625-479b-88d1-c4d4d522234e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02bcd51f-02b9-4d28-be3f-c0b3ea8aff46 req-16da9e42-2687-47a0-bc9b-2c1aefb8c0d2 service nova] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-02bcd51f-02b9-4d28-be3f-c0b3ea8aff46 req-16da9e42-2687-47a0-bc9b-2c1aefb8c0d2 service nova] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.compute.manager [req-02bcd51f-02b9-4d28-be3f-c0b3ea8aff46 req-16da9e42-2687-47a0-bc9b-2c1aefb8c0d2 service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] No waiting events found dispatching network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:38:50 user nova-compute[74892]: WARNING nova.compute.manager [req-02bcd51f-02b9-4d28-be3f-c0b3ea8aff46 req-16da9e42-2687-47a0-bc9b-2c1aefb8c0d2 service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received unexpected event network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 for instance with vm_state building and task_state spawning.
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:38:50 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Instance spawned successfully.
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:38:50 user nova-compute[74892]: INFO nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 15 14:38:50 user nova-compute[74892]: DEBUG nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:38:50 user nova-compute[74892]: INFO nova.compute.manager [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Took 6.77 seconds to build instance.
Nov 15 14:38:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0e96c68-ec4a-4871-86aa-2aad8ea8981d tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "e3554958-4625-479b-88d1-c4d4d522234e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.860s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:38:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:38:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:38:58 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:38:58 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8208MB free_disk=25.061050415039062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 87e2190a-c0eb-49da-a757-98a9175946e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e3554958-4625-479b-88d1-c4d4d522234e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:38:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:38:59 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:38:59 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:38:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:38:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:38:59 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:39:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:39:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:39:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:39:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:39:01 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:39:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:39:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:39:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:39:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:01 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:02 user nova-compute[74892]: INFO nova.compute.manager [None req-c3d6f02a-bf33-4c14-8811-c4a782b5f0f8 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Unrescuing
Nov 15 14:39:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3d6f02a-bf33-4c14-8811-c4a782b5f0f8 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:39:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3d6f02a-bf33-4c14-8811-c4a782b5f0f8 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquired lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:39:02 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3d6f02a-bf33-4c14-8811-c4a782b5f0f8 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:39:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-c3d6f02a-bf33-4c14-8811-c4a782b5f0f8 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c3d6f02a-bf33-4c14-8811-c4a782b5f0f8 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Releasing lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c3d6f02a-bf33-4c14-8811-c4a782b5f0f8 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'flavor' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-f0ad89f4-c5ff-4382-bf7c-8a25345fa9ab req-f91d9cb5-c67c-440e-a51c-d2e51c1ce6c9 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f0ad89f4-c5ff-4382-bf7c-8a25345fa9ab req-f91d9cb5-c67c-440e-a51c-d2e51c1ce6c9 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f0ad89f4-c5ff-4382-bf7c-8a25345fa9ab req-f91d9cb5-c67c-440e-a51c-d2e51c1ce6c9 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f0ad89f4-c5ff-4382-bf7c-8a25345fa9ab req-f91d9cb5-c67c-440e-a51c-d2e51c1ce6c9 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-f0ad89f4-c5ff-4382-bf7c-8a25345fa9ab req-f91d9cb5-c67c-440e-a51c-d2e51c1ce6c9 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:03 user nova-compute[74892]: WARNING nova.compute.manager [req-f0ad89f4-c5ff-4382-bf7c-8a25345fa9ab req-f91d9cb5-c67c-440e-a51c-d2e51c1ce6c9 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:39:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance destroyed successfully.
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:06 user nova-compute[74892]: WARNING nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:06 user nova-compute[74892]: WARNING nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:06 user nova-compute[74892]: WARNING nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:06 user nova-compute[74892]: WARNING nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:06 user nova-compute[74892]: WARNING nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:06 user nova-compute[74892]: DEBUG nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:06 user nova-compute[74892]: WARNING nova.compute.manager [req-34f0ee72-be6f-41c5-9a37-1dfc8ad6f1b5 req-0c26ca21-e406-4839-a5b8-675826eaf97b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state rescued and task_state unrescuing.
Nov 15 14:39:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-c3d6f02a-bf33-4c14-8811-c4a782b5f0f8 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:39:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-c261c7a2-6fd1-4917-9609-b08720fa9078 req-5a4404a8-c5bc-4c66-a9d3-ef9cb224b8a8 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c261c7a2-6fd1-4917-9609-b08720fa9078 req-5a4404a8-c5bc-4c66-a9d3-ef9cb224b8a8 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c261c7a2-6fd1-4917-9609-b08720fa9078 req-5a4404a8-c5bc-4c66-a9d3-ef9cb224b8a8 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c261c7a2-6fd1-4917-9609-b08720fa9078 req-5a4404a8-c5bc-4c66-a9d3-ef9cb224b8a8 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-c261c7a2-6fd1-4917-9609-b08720fa9078 req-5a4404a8-c5bc-4c66-a9d3-ef9cb224b8a8 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:08 user nova-compute[74892]: WARNING nova.compute.manager [req-c261c7a2-6fd1-4917-9609-b08720fa9078 req-5a4404a8-c5bc-4c66-a9d3-ef9cb224b8a8 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state active and task_state None.
Nov 15 14:39:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-767354cf-8055-4688-ae30-8533340b4a26 req-91f2b012-8b35-4a3c-aad2-730fafab9a4d service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received event network-changed-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-767354cf-8055-4688-ae30-8533340b4a26 req-91f2b012-8b35-4a3c-aad2-730fafab9a4d service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Refreshing instance network info cache due to event network-changed-f252a817-3ef0-431d-bece-40581512b9e2. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:39:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-767354cf-8055-4688-ae30-8533340b4a26 req-91f2b012-8b35-4a3c-aad2-730fafab9a4d service nova] Acquiring lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:39:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-767354cf-8055-4688-ae30-8533340b4a26 req-91f2b012-8b35-4a3c-aad2-730fafab9a4d service nova] Acquired lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:39:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-767354cf-8055-4688-ae30-8533340b4a26 req-91f2b012-8b35-4a3c-aad2-730fafab9a4d service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Refreshing network info cache for port f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:39:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-767354cf-8055-4688-ae30-8533340b4a26 req-91f2b012-8b35-4a3c-aad2-730fafab9a4d service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Updated VIF entry in instance network info cache for port f252a817-3ef0-431d-bece-40581512b9e2. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:39:13 user nova-compute[74892]: DEBUG nova.network.neutron [req-767354cf-8055-4688-ae30-8533340b4a26 req-91f2b012-8b35-4a3c-aad2-730fafab9a4d service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Updating instance_info_cache with network_info: [{"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:39:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-767354cf-8055-4688-ae30-8533340b4a26 req-91f2b012-8b35-4a3c-aad2-730fafab9a4d service nova] Releasing lock "refresh_cache-87e2190a-c0eb-49da-a757-98a9175946e6" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "87e2190a-c0eb-49da-a757-98a9175946e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "87e2190a-c0eb-49da-a757-98a9175946e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:14 user nova-compute[74892]: INFO nova.compute.manager [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Terminating instance
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-f9ea484a-6e5b-453a-a402-ab2628b65c60 req-016751f6-8c92-49eb-8d1e-ced35febe77a service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received event network-vif-unplugged-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f9ea484a-6e5b-453a-a402-ab2628b65c60 req-016751f6-8c92-49eb-8d1e-ced35febe77a service nova] Acquiring lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f9ea484a-6e5b-453a-a402-ab2628b65c60 req-016751f6-8c92-49eb-8d1e-ced35febe77a service nova] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f9ea484a-6e5b-453a-a402-ab2628b65c60 req-016751f6-8c92-49eb-8d1e-ced35febe77a service nova] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-f9ea484a-6e5b-453a-a402-ab2628b65c60 req-016751f6-8c92-49eb-8d1e-ced35febe77a service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] No waiting events found dispatching network-vif-unplugged-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-f9ea484a-6e5b-453a-a402-ab2628b65c60 req-016751f6-8c92-49eb-8d1e-ced35febe77a service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received event network-vif-unplugged-f252a817-3ef0-431d-bece-40581512b9e2 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:39:14 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Instance destroyed successfully.
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'resources' on Instance uuid 87e2190a-c0eb-49da-a757-98a9175946e6 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-358697145',display_name='tempest-TestVolumeBootPattern-server-358697145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-358697145',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:37:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-rpi0wl12',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:37:33Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=87e2190a-c0eb-49da-a757-98a9175946e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "f252a817-3ef0-431d-bece-40581512b9e2", "address": "fa:16:3e:6e:45:d1", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf252a817-3e", "ovs_interfaceid": "f252a817-3ef0-431d-bece-40581512b9e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:45:d1,bridge_name='br-int',has_traffic_filtering=True,id=f252a817-3ef0-431d-bece-40581512b9e2,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf252a817-3e') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_vif [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:45:d1,bridge_name='br-int',has_traffic_filtering=True,id=f252a817-3ef0-431d-bece-40581512b9e2,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf252a817-3e') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf252a817-3e, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3cbc1b4-da7d-4337-ba4a-b560c1695a12) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:39:14 user nova-compute[74892]: INFO os_vif [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:45:d1,bridge_name='br-int',has_traffic_filtering=True,id=f252a817-3ef0-431d-bece-40581512b9e2,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf252a817-3e')
Nov 15 14:39:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRgGkCDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:39:14 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e4031f-5061-496a-8989-9925e06529d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:39:14 user nova-compute[74892]: No targets found.
Nov 15 14:39:14 user nova-compute[74892]: iSNS:
Nov 15 14:39:14 user nova-compute[74892]: No targets found.
Nov 15 14:39:14 user nova-compute[74892]: STATIC:
Nov 15 14:39:14 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172
Nov 15 14:39:14 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:39:14 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:39:14 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9
Nov 15 14:39:14 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:39:14 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:39:14 user nova-compute[74892]: FIRMWARE:
Nov 15 14:39:14 user nova-compute[74892]: No targets found.
Nov 15 14:39:14 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:39:14 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:39:14 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12e157e-07d4-4f58-b5d5-8f44582041b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[baed1285-61db-432b-8f1b-32286fcd5ee6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:39:14 user nova-compute[74892]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:39:14 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:39:14 user nova-compute[74892]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:39:14 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd005f1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83ef1e2-74ca-459b-812a-75b735ba7243]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[519d0955-bf49-4bf9-8521-031992a53fea]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaddc0c-b1e8-435b-b24d-b0c290498fe2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4dd243-cd40-4e21-a347-7079c2dbe4fd]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOda3e7339-a9bd0d71fdf1b91a', '/dev/disk/by-id/scsi-26139626430643731', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_da3e7339') {{(pid=85038) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 14:39:15 user nova-compute[74892]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOda3e7339-a9bd0d71fdf1b91a
Nov 15 14:39:15 user nova-compute[74892]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26139626430643731
Nov 15 14:39:15 user nova-compute[74892]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_da3e7339
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c99a997-a1cc-4824-9b9d-5bcd2e3cba3e]: (4, None) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7435eeb9-7072-467e-936d-342b6ee53dbf]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a0bca8-b09f-48a9-a950-d9e8f407281e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260]
Nov 15 14:39:15 user nova-compute[74892]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260] successful.
Nov 15 14:39:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[037cc83b-7974-4061-a64e-2c7d9e10dfd8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== disconnect_volume: return (301ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:39:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Deleting instance files /opt/stack/data/nova/instances/87e2190a-c0eb-49da-a757-98a9175946e6_del
Nov 15 14:39:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Deletion of /opt/stack/data/nova/instances/87e2190a-c0eb-49da-a757-98a9175946e6_del complete
Nov 15 14:39:15 user nova-compute[74892]: INFO nova.compute.manager [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:39:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-a9f11edc-d4d2-490f-b746-6c766c3f9df9 req-4d355a1d-fca2-47ee-8304-1cd85c773281 service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received event network-vif-deleted-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:15 user nova-compute[74892]: INFO nova.compute.manager [req-a9f11edc-d4d2-490f-b746-6c766c3f9df9 req-4d355a1d-fca2-47ee-8304-1cd85c773281 service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Neutron deleted interface f252a817-3ef0-431d-bece-40581512b9e2; detaching it from the instance and deleting it from the info cache
Nov 15 14:39:15 user nova-compute[74892]: DEBUG nova.network.neutron [req-a9f11edc-d4d2-490f-b746-6c766c3f9df9 req-4d355a1d-fca2-47ee-8304-1cd85c773281 service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:39:15 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Took 0.63 seconds to deallocate network for instance.
Nov 15 14:39:15 user nova-compute[74892]: DEBUG nova.compute.manager [req-a9f11edc-d4d2-490f-b746-6c766c3f9df9 req-4d355a1d-fca2-47ee-8304-1cd85c773281 service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Detach interface failed, port_id=f252a817-3ef0-431d-bece-40581512b9e2, reason: Instance 87e2190a-c0eb-49da-a757-98a9175946e6 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-e86c3f93-3b6f-4486-8da7-1ed3696c980b req-326dda21-8e1d-4487-a78a-1f7535d93d86 service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received event network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e86c3f93-3b6f-4486-8da7-1ed3696c980b req-326dda21-8e1d-4487-a78a-1f7535d93d86 service nova] Acquiring lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e86c3f93-3b6f-4486-8da7-1ed3696c980b req-326dda21-8e1d-4487-a78a-1f7535d93d86 service nova] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e86c3f93-3b6f-4486-8da7-1ed3696c980b req-326dda21-8e1d-4487-a78a-1f7535d93d86 service nova] Lock "87e2190a-c0eb-49da-a757-98a9175946e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-e86c3f93-3b6f-4486-8da7-1ed3696c980b req-326dda21-8e1d-4487-a78a-1f7535d93d86 service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] No waiting events found dispatching network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:39:16 user nova-compute[74892]: WARNING nova.compute.manager [req-e86c3f93-3b6f-4486-8da7-1ed3696c980b req-326dda21-8e1d-4487-a78a-1f7535d93d86 service nova] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Received unexpected event network-vif-plugged-f252a817-3ef0-431d-bece-40581512b9e2 for instance with vm_state active and task_state deleting.
Nov 15 14:39:16 user nova-compute[74892]: INFO nova.compute.manager [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: 87e2190a-c0eb-49da-a757-98a9175946e6] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 14:39:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:39:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:16 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Deleted allocations for instance 87e2190a-c0eb-49da-a757-98a9175946e6
Nov 15 14:39:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a6046002-8dd7-430c-abe2-01fe97caba89 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "87e2190a-c0eb-49da-a757-98a9175946e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.953s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:39:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:39:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:39:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:39:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-d9794fc4-4679-4427-9518-811a43963251 req-0c74e73b-2019-4059-a79e-1d58dbfe4344 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-changed-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:39:48 user nova-compute[74892]: DEBUG nova.compute.manager [req-d9794fc4-4679-4427-9518-811a43963251 req-0c74e73b-2019-4059-a79e-1d58dbfe4344 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Refreshing instance network info cache due to event network-changed-500820b5-a335-4501-ab44-3d994600fc78. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:39:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d9794fc4-4679-4427-9518-811a43963251 req-0c74e73b-2019-4059-a79e-1d58dbfe4344 service nova] Acquiring lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:39:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d9794fc4-4679-4427-9518-811a43963251 req-0c74e73b-2019-4059-a79e-1d58dbfe4344 service nova] Acquired lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:39:48 user nova-compute[74892]: DEBUG nova.network.neutron [req-d9794fc4-4679-4427-9518-811a43963251 req-0c74e73b-2019-4059-a79e-1d58dbfe4344 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Refreshing network info cache for port 500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:39:49 user nova-compute[74892]: DEBUG nova.network.neutron [req-d9794fc4-4679-4427-9518-811a43963251 req-0c74e73b-2019-4059-a79e-1d58dbfe4344 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updated VIF entry in instance network info cache for port 500820b5-a335-4501-ab44-3d994600fc78. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:39:49 user nova-compute[74892]: DEBUG nova.network.neutron [req-d9794fc4-4679-4427-9518-811a43963251 req-0c74e73b-2019-4059-a79e-1d58dbfe4344 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating instance_info_cache with network_info: [{"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:39:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d9794fc4-4679-4427-9518-811a43963251 req-0c74e73b-2019-4059-a79e-1d58dbfe4344 service nova] Releasing lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:39:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:52 user nova-compute[74892]: INFO nova.compute.manager [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attaching volume 2cb0cdb6-0a11-4f83-897c-300b89c32640 to /dev/vdb
Nov 15 14:39:52 user nova-compute[74892]: DEBUG os_brick.utils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b7a65a-2446-4c67-9741-0b83c31b7220]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[30db525e-7ddf-4ffe-ab99-482a1a995b16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec6b34b-af54-4d76-8210-b6bd235822a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5f0d8a-6330-4bd5-86ca-2bdd0962e2eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:39:52 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:39:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec23e944-afe8-4cc0-aaf3-8629d437b649]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG os_brick.utils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:39:52 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating existing volume attachment record: 322d8d6b-2934-43dd-85b7-ab193af23e37 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:39:54 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:39:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:54 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:39:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oycaYCNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:39:57 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:39:57 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:39:57 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:39:57 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8292MB free_disk=25.030590057373047GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f18c454-8818-4055-aac5-43db55281dff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:39:57 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b02f67-4773-4cb7-b416-e551a1131a7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640] added
Nov 15 14:39:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a01d00-b705-4ed2-a3d9-3c74d8885fce]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe51ead6-2db6-404a-80ef-a83b5f51a5d1]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oycaYCNT {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oycaYCNT" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce06afe5-2739-40ee-a6cd-1810b196818e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oycaYCNT'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e3554958-4625-479b-88d1-c4d4d522234e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f16316-fde3-4749-85fc-77043183a54c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9210de9-b42f-420c-b4e4-b86c702f8606]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:39:58 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:39:58 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0768eff-7daf-48a0-b3c7-0609952e711a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640, portal: 172.16.0.220,3260]
Nov 15 14:39:58 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640, portal: 172.16.0.220,3260] successful.
Nov 15 14:39:58 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[126321ff-d6af-4a28-b916-7e786b4e0907]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[785e96c1-08ef-4dd9-986e-0fa9f3d5cf80]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:39:58 user nova-compute[74892]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)
Nov 15 14:39:58 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:39:58 user nova-compute[74892]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)
Nov 15 14:39:58 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0807e0-f64d-4b96-8b87-4abb1ce6f294]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:39:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oycaYCNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26536333638663236', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536333638663236', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:39:59 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:39:59 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:39:59 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:39:59 user nova-compute[74892]:   <serial>2cb0cdb6-0a11-4f83-897c-300b89c32640</serial>
Nov 15 14:39:59 user nova-compute[74892]: </disk>
Nov 15 14:39:59 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No VIF found with MAC fa:16:3e:cd:1e:14, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae0da647-cdcd-48a9-9366-8f9bdfc21ac7 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.944s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:39:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updating instance_info_cache with network_info: [{"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-95ff8c73-db6f-4f15-a42f-83133b4fd7b1" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:40:01 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:40:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:05 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:40:05 user nova-compute[74892]: INFO nova.compute.claims [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Claim successful on node user
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.network.neutron [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:40:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.policy [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c73da782783d41dbb370c3df04dec208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdd6323d06f4337995cbb796778b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:40:06 user nova-compute[74892]: INFO nova.virt.block_device [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Booting with volume ccb8a2b6-6730-43f4-bb8c-2e30855404a9 at /dev/vda
Nov 15 14:40:06 user nova-compute[74892]: DEBUG os_brick.utils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a435f0c1-2253-4ecc-a189-48937d311790]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8597cfa6-9ddf-44a1-bd96-330938e11a4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a016a33-290d-4a71-b58a-d235c78030d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd180157-cc33-4675-a292-6b6b541b81dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:40:06 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:40:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0aeacc-ebd5-4357-a67b-f278371d4504]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG os_brick.utils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updating existing volume attachment record: 5d69c71a-4973-4e10-9dd9-73ce9c963042 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:06 user nova-compute[74892]: DEBUG nova.network.neutron [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Successfully created port: db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Successfully updated port: db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquired lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-efa81488-b8b8-451b-96c4-e858f454625e req-aece4d39-c12c-4622-b5fd-c3450ca580a5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-changed-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-efa81488-b8b8-451b-96c4-e858f454625e req-aece4d39-c12c-4622-b5fd-c3450ca580a5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Refreshing instance network info cache due to event network-changed-db381515-87a5-4052-a816-a653d6860473. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-efa81488-b8b8-451b-96c4-e858f454625e req-aece4d39-c12c-4622-b5fd-c3450ca580a5 service nova] Acquiring lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updating instance_info_cache with network_info: [{"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Releasing lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Instance network_info: |[{"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-efa81488-b8b8-451b-96c4-e858f454625e req-aece4d39-c12c-4622-b5fd-c3450ca580a5 service nova] Acquired lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:40:07 user nova-compute[74892]: DEBUG nova.network.neutron [req-efa81488-b8b8-451b-96c4-e858f454625e req-aece4d39-c12c-4622-b5fd-c3450ca580a5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Refreshing network info cache for port db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:40:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-efa81488-b8b8-451b-96c4-e858f454625e req-aece4d39-c12c-4622-b5fd-c3450ca580a5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updated VIF entry in instance network info cache for port db381515-87a5-4052-a816-a653d6860473. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:40:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-efa81488-b8b8-451b-96c4-e858f454625e req-aece4d39-c12c-4622-b5fd-c3450ca580a5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updating instance_info_cache with network_info: [{"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:40:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-efa81488-b8b8-451b-96c4-e858f454625e req-aece4d39-c12c-4622-b5fd-c3450ca580a5 service nova] Releasing lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:40:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:10 user nova-compute[74892]: INFO nova.compute.manager [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Detaching volume 2cb0cdb6-0a11-4f83-897c-300b89c32640
Nov 15 14:40:10 user nova-compute[74892]: INFO nova.virt.block_device [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attempting to driver detach volume 2cb0cdb6-0a11-4f83-897c-300b89c32640 from mountpoint /dev/vdb
Nov 15 14:40:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Attempting to detach device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:40:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:40:10 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:40:10 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:40:10 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:40:10 user nova-compute[74892]:   <serial>2cb0cdb6-0a11-4f83-897c-300b89c32640</serial>
Nov 15 14:40:10 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:40:10 user nova-compute[74892]: </disk>
Nov 15 14:40:10 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:40:10 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully detached device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the persistent domain config.
Nov 15 14:40:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:40:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:40:10 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:40:10 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:40:10 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:40:10 user nova-compute[74892]:   <serial>2cb0cdb6-0a11-4f83-897c-300b89c32640</serial>
Nov 15 14:40:10 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:40:10 user nova-compute[74892]: </disk>
Nov 15 14:40:10 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:40:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Creating image(s)
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Ensure instance console log exists: /opt/stack/data/nova/instances/e15b92a9-d27c-41c3-b3da-a6419509fd8f/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Start _get_guest_xml network_info=[{"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRgGkCDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e15b92a9-d27c-41c3-b3da-a6419509fd8f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'serial': 'ccb8a2b6-6730-43f4-bb8c-2e30855404a9'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '5d69c71a-4973-4e10-9dd9-73ce9c963042', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:40:11 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:40:11 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRgGkCDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:40:11 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:40:11 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:40:11 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5eacd6-1ed8-4ab5-920e-a86553c28bc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:40:11 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2899013-2abb-43bd-b5e5-b8866afab92d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9] added
Nov 15 14:40:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e74839-81fc-4982-9390-3d431078b602]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6870fc-4d15-4825-9eb3-7fc4f18f6ea6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRgGkCDi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRgGkCDi" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b2c57-62a1-4a46-a83f-1d55770e5c35]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRgGkCDi'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[43802cb1-a0a0-4c2c-9d8f-4b68702ca1be]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2433b7-ce83-47c0-9dad-857f41033637]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[614e1a83-3a97-47f6-aa4d-f2499f3b511c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260]
Nov 15 14:40:11 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260] successful.
Nov 15 14:40:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13eab4d-163d-4b57-9abb-c5bbda6892e4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecfd28a-c9f5-4c9a-a0af-1b6ae945e76d]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:40:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[10598a74-828b-429b-a1e6-3271c47e8745]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:40:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRgGkCDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26139626430643731', 'path': '/dev/sdd'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139626430643731', 'path': '/dev/sdd'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500463630',display_name='tempest-TestVolumeBootPattern-server-500463630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500463630',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-cwkdwqo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:40:06Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=e15b92a9-d27c-41c3-b3da-a6419509fd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f4:60,bridge_name='br-int',has_traffic_filtering=True,id=db381515-87a5-4052-a816-a653d6860473,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb381515-87') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'pci_devices' on Instance uuid e15b92a9-d27c-41c3-b3da-a6419509fd8f {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:40:12 user nova-compute[74892]:   <uuid>e15b92a9-d27c-41c3-b3da-a6419509fd8f</uuid>
Nov 15 14:40:12 user nova-compute[74892]:   <name>instance-0000002e</name>
Nov 15 14:40:12 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:40:12 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:40:12 user nova-compute[74892]:   <metadata>
Nov 15 14:40:12 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:40:12 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:40:12 user nova-compute[74892]:       <nova:name>tempest-TestVolumeBootPattern-server-500463630</nova:name>
Nov 15 14:40:12 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:40:11</nova:creationTime>
Nov 15 14:40:12 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:40:12 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:40:12 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:40:12 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:40:12 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:40:12 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:40:12 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:40:12 user nova-compute[74892]:       <nova:owner>
Nov 15 14:40:12 user nova-compute[74892]:         <nova:user uuid="c73da782783d41dbb370c3df04dec208">tempest-TestVolumeBootPattern-1799633332-project-member</nova:user>
Nov 15 14:40:12 user nova-compute[74892]:         <nova:project uuid="1cdd6323d06f4337995cbb796778b449">tempest-TestVolumeBootPattern-1799633332</nova:project>
Nov 15 14:40:12 user nova-compute[74892]:       </nova:owner>
Nov 15 14:40:12 user nova-compute[74892]:       <nova:ports>
Nov 15 14:40:12 user nova-compute[74892]:         <nova:port uuid="db381515-87a5-4052-a816-a653d6860473">
Nov 15 14:40:12 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 14:40:12 user nova-compute[74892]:         </nova:port>
Nov 15 14:40:12 user nova-compute[74892]:       </nova:ports>
Nov 15 14:40:12 user nova-compute[74892]:     </nova:instance>
Nov 15 14:40:12 user nova-compute[74892]:   </metadata>
Nov 15 14:40:12 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:40:12 user nova-compute[74892]:     <system>
Nov 15 14:40:12 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:40:12 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:40:12 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:40:12 user nova-compute[74892]:       <entry name="serial">e15b92a9-d27c-41c3-b3da-a6419509fd8f</entry>
Nov 15 14:40:12 user nova-compute[74892]:       <entry name="uuid">e15b92a9-d27c-41c3-b3da-a6419509fd8f</entry>
Nov 15 14:40:12 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:40:12 user nova-compute[74892]:     </system>
Nov 15 14:40:12 user nova-compute[74892]:   </sysinfo>
Nov 15 14:40:12 user nova-compute[74892]:   <os>
Nov 15 14:40:12 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:40:12 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:40:12 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:40:12 user nova-compute[74892]:   </os>
Nov 15 14:40:12 user nova-compute[74892]:   <features>
Nov 15 14:40:12 user nova-compute[74892]:     <acpi/>
Nov 15 14:40:12 user nova-compute[74892]:     <apic/>
Nov 15 14:40:12 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:40:12 user nova-compute[74892]:   </features>
Nov 15 14:40:12 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:40:12 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:40:12 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:40:12 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:40:12 user nova-compute[74892]:   </clock>
Nov 15 14:40:12 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:40:12 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:40:12 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:40:12 user nova-compute[74892]:   </cpu>
Nov 15 14:40:12 user nova-compute[74892]:   <devices>
Nov 15 14:40:12 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:40:12 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:40:12 user nova-compute[74892]:       <source dev="/dev/sdd"/>
Nov 15 14:40:12 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:40:12 user nova-compute[74892]:       <serial>ccb8a2b6-6730-43f4-bb8c-2e30855404a9</serial>
Nov 15 14:40:12 user nova-compute[74892]:     </disk>
Nov 15 14:40:12 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:40:12 user nova-compute[74892]:       <mac address="fa:16:3e:9c:f4:60"/>
Nov 15 14:40:12 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:40:12 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:40:12 user nova-compute[74892]:       <target dev="tapdb381515-87"/>
Nov 15 14:40:12 user nova-compute[74892]:     </interface>
Nov 15 14:40:12 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:40:12 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/e15b92a9-d27c-41c3-b3da-a6419509fd8f/console.log" append="off"/>
Nov 15 14:40:12 user nova-compute[74892]:     </serial>
Nov 15 14:40:12 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:40:12 user nova-compute[74892]:     <video>
Nov 15 14:40:12 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:40:12 user nova-compute[74892]:     </video>
Nov 15 14:40:12 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:40:12 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:40:12 user nova-compute[74892]:     </rng>
Nov 15 14:40:12 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:40:12 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:40:12 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:40:12 user nova-compute[74892]:     </memballoon>
Nov 15 14:40:12 user nova-compute[74892]:   </devices>
Nov 15 14:40:12 user nova-compute[74892]: </domain>
Nov 15 14:40:12 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500463630',display_name='tempest-TestVolumeBootPattern-server-500463630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500463630',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-cwkdwqo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:40:06Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=e15b92a9-d27c-41c3-b3da-a6419509fd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f4:60,bridge_name='br-int',has_traffic_filtering=True,id=db381515-87a5-4052-a816-a653d6860473,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb381515-87') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG os_vif [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f4:60,bridge_name='br-int',has_traffic_filtering=True,id=db381515-87a5-4052-a816-a653d6860473,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb381515-87') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2643a73a-d851-592c-9aee-561e839cee17', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb381515-87, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb381515-87, col_values=(('qos', UUID('efde1ab2-6d17-4b30-960c-555e03bafe11')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb381515-87, col_values=(('external_ids', {'iface-id': 'db381515-87a5-4052-a816-a653d6860473', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:f4:60', 'vm-uuid': 'e15b92a9-d27c-41c3-b3da-a6419509fd8f'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:12 user nova-compute[74892]: INFO os_vif [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f4:60,bridge_name='br-int',has_traffic_filtering=True,id=db381515-87a5-4052-a816-a653d6860473,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb381515-87')
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:40:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No VIF found with MAC fa:16:3e:9c:f4:60, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:40:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-dc444d2c-b69b-40cd-b0ad-8670abdd8efa req-8fdc5409-95c7-4b7e-9b6e-1bfca668b046 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:40:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dc444d2c-b69b-40cd-b0ad-8670abdd8efa req-8fdc5409-95c7-4b7e-9b6e-1bfca668b046 service nova] Acquiring lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dc444d2c-b69b-40cd-b0ad-8670abdd8efa req-8fdc5409-95c7-4b7e-9b6e-1bfca668b046 service nova] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-dc444d2c-b69b-40cd-b0ad-8670abdd8efa req-8fdc5409-95c7-4b7e-9b6e-1bfca668b046 service nova] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-dc444d2c-b69b-40cd-b0ad-8670abdd8efa req-8fdc5409-95c7-4b7e-9b6e-1bfca668b046 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] No waiting events found dispatching network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:40:14 user nova-compute[74892]: WARNING nova.compute.manager [req-dc444d2c-b69b-40cd-b0ad-8670abdd8efa req-8fdc5409-95c7-4b7e-9b6e-1bfca668b046 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received unexpected event network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 for instance with vm_state building and task_state spawning.
Nov 15 14:40:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:40:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:40:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Instance spawned successfully.
Nov 15 14:40:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:40:16 user nova-compute[74892]: INFO nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-b0f2d716-248d-4a6c-b9c6-7e78c1f78473 req-32f4cc1d-f891-41b9-b21b-f542bee378b2 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b0f2d716-248d-4a6c-b9c6-7e78c1f78473 req-32f4cc1d-f891-41b9-b21b-f542bee378b2 service nova] Acquiring lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b0f2d716-248d-4a6c-b9c6-7e78c1f78473 req-32f4cc1d-f891-41b9-b21b-f542bee378b2 service nova] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b0f2d716-248d-4a6c-b9c6-7e78c1f78473 req-32f4cc1d-f891-41b9-b21b-f542bee378b2 service nova] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-b0f2d716-248d-4a6c-b9c6-7e78c1f78473 req-32f4cc1d-f891-41b9-b21b-f542bee378b2 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] No waiting events found dispatching network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:40:16 user nova-compute[74892]: WARNING nova.compute.manager [req-b0f2d716-248d-4a6c-b9c6-7e78c1f78473 req-32f4cc1d-f891-41b9-b21b-f542bee378b2 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received unexpected event network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 for instance with vm_state building and task_state spawning.
Nov 15 14:40:16 user nova-compute[74892]: INFO nova.compute.manager [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Took 10.42 seconds to build instance.
Nov 15 14:40:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-035dcd8c-0be3-4c25-a28b-cb4f59b34da5 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.549s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:40:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:40:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:40:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:40:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:31 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 is timed out.
Nov 15 14:40:31 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully detached device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the live domain config.
Nov 15 14:40:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oycaYCNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:40:31 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed66699-6f26-4531-bd50-b34cf73eeef8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:40:31 user nova-compute[74892]: No targets found.
Nov 15 14:40:31 user nova-compute[74892]: iSNS:
Nov 15 14:40:31 user nova-compute[74892]: No targets found.
Nov 15 14:40:31 user nova-compute[74892]: STATIC:
Nov 15 14:40:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640
Nov 15 14:40:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:40:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:40:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172
Nov 15 14:40:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:40:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:40:31 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9
Nov 15 14:40:31 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:40:31 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:40:31 user nova-compute[74892]: FIRMWARE:
Nov 15 14:40:31 user nova-compute[74892]: No targets found.
Nov 15 14:40:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:40:31 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:40:31 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fa1c1e-f91c-4c86-81f3-5056de961259]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c264d097-28c3-40c8-b92c-678c98f2e817]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:40:31 user nova-compute[74892]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)
Nov 15 14:40:31 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:40:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:40:31 user nova-compute[74892]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 (non-flash)
Nov 15 14:40:31 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:40:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2016e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[086214d1-6f26-49d5-ba39-45b7f68fac67]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a691245-bc04-483f-b8e5-8c16cd5a3483]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a80d3d-21a7-4916-9409-93a79f554082]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[011f6809-9514-4fc9-b6eb-95aad48ad05b]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[959cbdc9-b99f-438c-99e7-9bb5287ce2ef]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab7ac4-99aa-4f32-9a8d-45714d3db7db]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640, portal: 172.16.0.220,3260]
Nov 15 14:40:31 user nova-compute[74892]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640, portal: 172.16.0.220,3260] successful.
Nov 15 14:40:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cb0cdb6-0a11-4f83-897c-300b89c32640 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a393b2fb-2d07-4ee7-9b81-c640d4f8d360]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== disconnect_volume: return (307ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:40:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:40:32 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:40:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c49b0746-6bc4-450d-b21a-edf5b9b60523 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.599s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "e3554958-4625-479b-88d1-c4d4d522234e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "e3554958-4625-479b-88d1-c4d4d522234e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "e3554958-4625-479b-88d1-c4d4d522234e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:33 user nova-compute[74892]: INFO nova.compute.manager [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Terminating instance
Nov 15 14:40:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-73e9e9af-3666-4b29-b169-c23fbf9836b9 req-71e7a9da-1831-4019-8f72-01a0fe82de9e service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received event network-vif-unplugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-73e9e9af-3666-4b29-b169-c23fbf9836b9 req-71e7a9da-1831-4019-8f72-01a0fe82de9e service nova] Acquiring lock "e3554958-4625-479b-88d1-c4d4d522234e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-73e9e9af-3666-4b29-b169-c23fbf9836b9 req-71e7a9da-1831-4019-8f72-01a0fe82de9e service nova] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-73e9e9af-3666-4b29-b169-c23fbf9836b9 req-71e7a9da-1831-4019-8f72-01a0fe82de9e service nova] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-73e9e9af-3666-4b29-b169-c23fbf9836b9 req-71e7a9da-1831-4019-8f72-01a0fe82de9e service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] No waiting events found dispatching network-vif-unplugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-73e9e9af-3666-4b29-b169-c23fbf9836b9 req-71e7a9da-1831-4019-8f72-01a0fe82de9e service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received event network-vif-unplugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Instance destroyed successfully.
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.objects.instance [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lazy-loading 'resources' on Instance uuid e3554958-4625-479b-88d1-c4d4d522234e {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:38:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1157653836',display_name='tempest-ServersNegativeTestJSON-server-1157653836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1157653836',id=45,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:38:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a8a34907a5846d68349968529f49dfc',ramdisk_id='',reservation_id='r-pss0zgvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1366943078',owner_user_name='tempest-ServersNegativeTestJSON-1366943078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:38:50Z,user_data=None,user_id='0502e4587dbc404da26bf5929fe2e3de',uuid=e3554958-4625-479b-88d1-c4d4d522234e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converting VIF {"id": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "address": "fa:16:3e:26:69:ff", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c9a89cb-55", "ovs_interfaceid": "5c9a89cb-556e-4371-9a90-6c5e73384ad5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:69:ff,bridge_name='br-int',has_traffic_filtering=True,id=5c9a89cb-556e-4371-9a90-6c5e73384ad5,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9a89cb-55') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG os_vif [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:69:ff,bridge_name='br-int',has_traffic_filtering=True,id=5c9a89cb-556e-4371-9a90-6c5e73384ad5,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9a89cb-55') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c9a89cb-55, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7c72e57-ca3d-40b6-814b-58e00c6bb2c2) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:34 user nova-compute[74892]: INFO os_vif [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:69:ff,bridge_name='br-int',has_traffic_filtering=True,id=5c9a89cb-556e-4371-9a90-6c5e73384ad5,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c9a89cb-55')
Nov 15 14:40:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Deleting instance files /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e_del
Nov 15 14:40:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Deletion of /opt/stack/data/nova/instances/e3554958-4625-479b-88d1-c4d4d522234e_del complete
Nov 15 14:40:34 user nova-compute[74892]: INFO nova.compute.manager [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 14:40:34 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:40:34 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: e3554958-4625-479b-88d1-c4d4d522234e] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:40:35 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:40:35 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Took 0.51 seconds to deallocate network for instance.
Nov 15 14:40:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:35 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:40:35 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:40:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:35 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Deleted allocations for instance e3554958-4625-479b-88d1-c4d4d522234e
Nov 15 14:40:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-6a069c24-ef88-4138-80e3-71ac2b88ddd0 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "e3554958-4625-479b-88d1-c4d4d522234e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.611s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3b63547-0600-482c-b96c-3490908aae3a req-4086b253-d52c-4a94-aee5-029af63b6ff2 service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received event network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:40:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3b63547-0600-482c-b96c-3490908aae3a req-4086b253-d52c-4a94-aee5-029af63b6ff2 service nova] Acquiring lock "e3554958-4625-479b-88d1-c4d4d522234e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3b63547-0600-482c-b96c-3490908aae3a req-4086b253-d52c-4a94-aee5-029af63b6ff2 service nova] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3b63547-0600-482c-b96c-3490908aae3a req-4086b253-d52c-4a94-aee5-029af63b6ff2 service nova] Lock "e3554958-4625-479b-88d1-c4d4d522234e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3b63547-0600-482c-b96c-3490908aae3a req-4086b253-d52c-4a94-aee5-029af63b6ff2 service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] No waiting events found dispatching network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:40:36 user nova-compute[74892]: WARNING nova.compute.manager [req-c3b63547-0600-482c-b96c-3490908aae3a req-4086b253-d52c-4a94-aee5-029af63b6ff2 service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received unexpected event network-vif-plugged-5c9a89cb-556e-4371-9a90-6c5e73384ad5 for instance with vm_state deleted and task_state None.
Nov 15 14:40:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3b63547-0600-482c-b96c-3490908aae3a req-4086b253-d52c-4a94-aee5-029af63b6ff2 service nova] [instance: e3554958-4625-479b-88d1-c4d4d522234e] Received event network-vif-deleted-5c9a89cb-556e-4371-9a90-6c5e73384ad5 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:40:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-8c20bc3e-bb8a-4a18-b0a3-0abec706ef24 req-255ade98-fd2b-4717-8580-e1a55090678b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-changed-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:40:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-8c20bc3e-bb8a-4a18-b0a3-0abec706ef24 req-255ade98-fd2b-4717-8580-e1a55090678b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Refreshing instance network info cache due to event network-changed-1932b387-4572-4580-a391-7f2a5791bf60. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:40:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8c20bc3e-bb8a-4a18-b0a3-0abec706ef24 req-255ade98-fd2b-4717-8580-e1a55090678b service nova] Acquiring lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:40:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8c20bc3e-bb8a-4a18-b0a3-0abec706ef24 req-255ade98-fd2b-4717-8580-e1a55090678b service nova] Acquired lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:40:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-8c20bc3e-bb8a-4a18-b0a3-0abec706ef24 req-255ade98-fd2b-4717-8580-e1a55090678b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Refreshing network info cache for port 1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:40:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-8c20bc3e-bb8a-4a18-b0a3-0abec706ef24 req-255ade98-fd2b-4717-8580-e1a55090678b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updated VIF entry in instance network info cache for port 1932b387-4572-4580-a391-7f2a5791bf60. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:40:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-8c20bc3e-bb8a-4a18-b0a3-0abec706ef24 req-255ade98-fd2b-4717-8580-e1a55090678b service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:40:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8c20bc3e-bb8a-4a18-b0a3-0abec706ef24 req-255ade98-fd2b-4717-8580-e1a55090678b service nova] Releasing lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:40:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:55 user nova-compute[74892]: INFO nova.compute.manager [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Detaching volume 5d7e496e-f8ca-4925-89d4-bb683e3b4172
Nov 15 14:40:55 user nova-compute[74892]: INFO nova.virt.block_device [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Attempting to driver detach volume 5d7e496e-f8ca-4925-89d4-bb683e3b4172 from mountpoint /dev/vdb
Nov 15 14:40:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Attempting to detach device vdb from instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:40:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:40:55 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:40:55 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:40:55 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:40:55 user nova-compute[74892]:   <serial>5d7e496e-f8ca-4925-89d4-bb683e3b4172</serial>
Nov 15 14:40:55 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:40:55 user nova-compute[74892]: </disk>
Nov 15 14:40:55 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:40:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Successfully detached device vdb from instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d from the persistent domain config.
Nov 15 14:40:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:40:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:40:55 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:40:55 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:40:55 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:40:55 user nova-compute[74892]:   <serial>5d7e496e-f8ca-4925-89d4-bb683e3b4172</serial>
Nov 15 14:40:55 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:40:55 user nova-compute[74892]: </disk>
Nov 15 14:40:55 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:40:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-74c8c1aa-8dd8-44af-a8c7-3e008a515736 req-3ee57e40-9e72-4546-8b8f-1779cc842fae service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-changed-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-74c8c1aa-8dd8-44af-a8c7-3e008a515736 req-3ee57e40-9e72-4546-8b8f-1779cc842fae service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Refreshing instance network info cache due to event network-changed-1932b387-4572-4580-a391-7f2a5791bf60. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-74c8c1aa-8dd8-44af-a8c7-3e008a515736 req-3ee57e40-9e72-4546-8b8f-1779cc842fae service nova] Acquiring lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-74c8c1aa-8dd8-44af-a8c7-3e008a515736 req-3ee57e40-9e72-4546-8b8f-1779cc842fae service nova] Acquired lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG nova.network.neutron [req-74c8c1aa-8dd8-44af-a8c7-3e008a515736 req-3ee57e40-9e72-4546-8b8f-1779cc842fae service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Refreshing network info cache for port 1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:40:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-74c8c1aa-8dd8-44af-a8c7-3e008a515736 req-3ee57e40-9e72-4546-8b8f-1779cc842fae service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updated VIF entry in instance network info cache for port 1932b387-4572-4580-a391-7f2a5791bf60. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-74c8c1aa-8dd8-44af-a8c7-3e008a515736 req-3ee57e40-9e72-4546-8b8f-1779cc842fae service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [{"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-74c8c1aa-8dd8-44af-a8c7-3e008a515736 req-3ee57e40-9e72-4546-8b8f-1779cc842fae service nova] Releasing lock "refresh_cache-9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:40:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:40:59 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:40:59 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=25.055984497070312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e15b92a9-d27c-41c3-b3da-a6419509fd8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:40:59 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:00 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updating instance_info_cache with network_info: [{"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-9a85430d-53e3-4181-9588-158654fe008d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:02 user nova-compute[74892]: INFO nova.compute.manager [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attaching volume 93d340ef-9f40-4973-a1d2-27172fc54953 to /dev/vdb
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG os_brick.utils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5428513f-c7ed-4b9a-8166-81ddf8d95bf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca847d93-3112-44ac-bea2-c2a4c7bd1937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[847378e2-b92b-4e33-9eec-7fbc28bcd39a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db9814b-ac72-4705-a00b-1b13a4b87b88]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:41:02 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:41:02 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[101188a2-7576-464c-8018-30dcdfd24e53]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG os_brick.utils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:41:02 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating existing volume attachment record: 5dae2347-8899-4a6a-9886-5b1f3b039dcb {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:41:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keoYsfjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:41:07 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:41:07 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:41:07 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea29a092-5d2c-4100-9836-fc0ba7a6c6b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:41:07 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c0cb8f-7390-432e-8603-49f5a5e37f2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953] added
Nov 15 14:41:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b22011e-04fc-49fd-859b-1f20a50c5b1b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f196828-e18e-46dd-8f89-2443eb2aeda5]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v keoYsfjF {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v keoYsfjF" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90a095c-ca00-4725-bcf2-ed1b2c37eb0f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'keoYsfjF'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc80038-0cde-418a-9aa7-515271341e19]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d0722-953a-444b-a374-92ac9aad3cb0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[985fddfd-13b0-4d71-a86f-a9307f7981e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953, portal: 172.16.0.220,3260]
Nov 15 14:41:07 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953, portal: 172.16.0.220,3260] successful.
Nov 15 14:41:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[49327d60-648d-4caf-a9d4-1a076fa06c87]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a16373-d646-48b2-9311-cca20b836aa8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)
Nov 15 14:41:07 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bbe5ad-69f8-4ee4-97b8-3f8880ceef9f]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:07 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:41:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:41:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keoYsfjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:41:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:41:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23438303336313536', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:41:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438303336313536', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:41:08 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:41:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:41:08 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:41:08 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:41:08 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:41:08 user nova-compute[74892]:   <serial>93d340ef-9f40-4973-a1d2-27172fc54953</serial>
Nov 15 14:41:08 user nova-compute[74892]: </disk>
Nov 15 14:41:08 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:41:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:41:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:41:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No VIF found with MAC fa:16:3e:cd:1e:14, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:41:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0075cb26-2003-47bf-a60c-f1da9d32b110 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.699s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:11 user nova-compute[74892]: INFO nova.compute.manager [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Detaching volume 93d340ef-9f40-4973-a1d2-27172fc54953
Nov 15 14:41:11 user nova-compute[74892]: INFO nova.virt.block_device [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attempting to driver detach volume 93d340ef-9f40-4973-a1d2-27172fc54953 from mountpoint /dev/vdb
Nov 15 14:41:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Attempting to detach device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:41:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:41:11 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:41:11 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:41:11 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:41:11 user nova-compute[74892]:   <serial>93d340ef-9f40-4973-a1d2-27172fc54953</serial>
Nov 15 14:41:11 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:41:11 user nova-compute[74892]: </disk>
Nov 15 14:41:11 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:41:11 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully detached device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the persistent domain config.
Nov 15 14:41:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:41:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:41:11 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:41:11 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:41:11 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:41:11 user nova-compute[74892]:   <serial>93d340ef-9f40-4973-a1d2-27172fc54953</serial>
Nov 15 14:41:11 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:41:11 user nova-compute[74892]: </disk>
Nov 15 14:41:11 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:41:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:41:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:15 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d is timed out.
Nov 15 14:41:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Successfully detached device vdb from instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d from the live domain config.
Nov 15 14:41:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lorzRFBH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:41:15 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcca829-5967-45b5-b7e4-f21ddc74229e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:41:15 user nova-compute[74892]: No targets found.
Nov 15 14:41:15 user nova-compute[74892]: iSNS:
Nov 15 14:41:15 user nova-compute[74892]: No targets found.
Nov 15 14:41:15 user nova-compute[74892]: STATIC:
Nov 15 14:41:15 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172
Nov 15 14:41:15 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:41:15 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:41:15 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9
Nov 15 14:41:15 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:41:15 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:41:15 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953
Nov 15 14:41:15 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:41:15 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:41:15 user nova-compute[74892]: FIRMWARE:
Nov 15 14:41:15 user nova-compute[74892]: No targets found.
Nov 15 14:41:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:41:15 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:41:15 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaae2a0-277b-4659-9ea7-dde0896bc4b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[473d3a69-b363-452f-91cf-e3d032090d7a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:41:15 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:41:15 user nova-compute[74892]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)
Nov 15 14:41:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 (non-flash)
Nov 15 14:41:15 user nova-compute[74892]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:41:15 user nova-compute[74892]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)
Nov 15 14:41:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd4c793eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[28107978-cb1a-4f72-bf1e-b8240c0d3164]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bcad7b-8984-4f4a-b3d7-83f02e235531]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f96ac2-c66a-428b-a2eb-865acce356de]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c495be-29a9-42a9-b9f8-0c6e1ca37c75]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14f2534-514d-4da1-bc57-2652e762676f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01e8460-7b20-4e52-ba78-5604f04edf1b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172, portal: 172.16.0.220,3260]
Nov 15 14:41:15 user nova-compute[74892]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172, portal: 172.16.0.220,3260] successful.
Nov 15 14:41:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d7e496e-f8ca-4925-89d4-bb683e3b4172 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e807f7d1-d618-45d9-8247-d9e8bd043a08]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] <== disconnect_volume: return (314ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:41:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:41:16 user nova-compute[74892]: DEBUG nova.objects.instance [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'flavor' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:41:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-237fef85-faf8-4321-b26c-691aa4657fe3 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:19 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:41:32 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 is timed out.
Nov 15 14:41:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully detached device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the live domain config.
Nov 15 14:41:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'keoYsfjF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:41:32 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1f14f-5ddf-4022-a874-8a571cfb9713]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:41:32 user nova-compute[74892]: No targets found.
Nov 15 14:41:32 user nova-compute[74892]: iSNS:
Nov 15 14:41:32 user nova-compute[74892]: No targets found.
Nov 15 14:41:32 user nova-compute[74892]: STATIC:
Nov 15 14:41:32 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9
Nov 15 14:41:32 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:41:32 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:41:32 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953
Nov 15 14:41:32 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:41:32 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:41:32 user nova-compute[74892]: FIRMWARE:
Nov 15 14:41:32 user nova-compute[74892]: No targets found.
Nov 15 14:41:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:41:32 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:41:32 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ecc20b-3bad-46b3-8258-22d751f0f0bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a5aaa2-a6ba-4afc-b542-05d74eb24da1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:41:32 user nova-compute[74892]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)
Nov 15 14:41:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:41:32 user nova-compute[74892]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 (non-flash)
Nov 15 14:41:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2057c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[883b1bd7-b107-4459-9e1f-539c95525d95]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85f28e0-93b3-4797-8015-463ad03909c6]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcda3286-496c-49d2-8be4-8809bbeb7720]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda0567d-bb8c-4459-a809-0fd01ccd836a]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cfd1cb-3ce0-4629-94aa-d456a82904a7]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4fb139-22b4-4731-94ef-d98235451087]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953, portal: 172.16.0.220,3260]
Nov 15 14:41:32 user nova-compute[74892]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953, portal: 172.16.0.220,3260] successful.
Nov 15 14:41:32 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d340ef-9f40-4973-a1d2-27172fc54953 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e288787e-5789-4e1f-a9c7-25c0b2c33243]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== disconnect_volume: return (312ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:41:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:41:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:41:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-07409154-f15f-415b-be0e-93962721fa00 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:41:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:45 user nova-compute[74892]: INFO nova.compute.manager [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Terminating instance
Nov 15 14:41:45 user nova-compute[74892]: DEBUG nova.compute.manager [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-e17b13d5-be32-4016-b589-c65adf516c51 req-ac869f5f-dbff-4b05-b1dc-e844f4e91695 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e17b13d5-be32-4016-b589-c65adf516c51 req-ac869f5f-dbff-4b05-b1dc-e844f4e91695 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e17b13d5-be32-4016-b589-c65adf516c51 req-ac869f5f-dbff-4b05-b1dc-e844f4e91695 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e17b13d5-be32-4016-b589-c65adf516c51 req-ac869f5f-dbff-4b05-b1dc-e844f4e91695 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-e17b13d5-be32-4016-b589-c65adf516c51 req-ac869f5f-dbff-4b05-b1dc-e844f4e91695 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG nova.compute.manager [req-e17b13d5-be32-4016-b589-c65adf516c51 req-ac869f5f-dbff-4b05-b1dc-e844f4e91695 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-unplugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:46 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Instance destroyed successfully.
Nov 15 14:41:46 user nova-compute[74892]: DEBUG nova.objects.instance [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'resources' on Instance uuid 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:35:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1548300691',display_name='tempest-ServerRescueNegativeTestJSON-server-1548300691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1548300691',id=41,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVZK0hMshfQI1nStccFJqSEJ4xCSBNif9T2xOmcZn+l9xds2ajFEa1z4u685xKg8EvnnI27QJwutQJETIhwGdLFJefb+qriPiiEmFaBnvjjARzi/805grNEMOLd8aE8MQ==',key_name='tempest-keypair-1639010971',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:37:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-61x2097t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:39:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=9ae2fc25-ebaf-4ec6-aa39-024abc893e3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "1932b387-4572-4580-a391-7f2a5791bf60", "address": "fa:16:3e:5a:18:91", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1932b387-45", "ovs_interfaceid": "1932b387-4572-4580-a391-7f2a5791bf60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:18:91,bridge_name='br-int',has_traffic_filtering=True,id=1932b387-4572-4580-a391-7f2a5791bf60,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932b387-45') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG os_vif [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:18:91,bridge_name='br-int',has_traffic_filtering=True,id=1932b387-4572-4580-a391-7f2a5791bf60,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932b387-45') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1932b387-45, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2846102-b393-472f-887c-aeb8b636a66e) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:41:46 user nova-compute[74892]: INFO os_vif [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:18:91,bridge_name='br-int',has_traffic_filtering=True,id=1932b387-4572-4580-a391-7f2a5791bf60,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1932b387-45')
Nov 15 14:41:46 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Deleting instance files /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d_del
Nov 15 14:41:46 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Deletion of /opt/stack/data/nova/instances/9ae2fc25-ebaf-4ec6-aa39-024abc893e3d_del complete
Nov 15 14:41:46 user nova-compute[74892]: INFO nova.compute.manager [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 14:41:46 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:41:46 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Took 0.66 seconds to deallocate network for instance.
Nov 15 14:41:46 user nova-compute[74892]: DEBUG nova.compute.manager [req-8ccb3275-3d2b-4291-8a6d-7bbe059a6c79 req-10b51f57-0ddb-4e00-bb00-e9841c97edd6 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-deleted-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:47 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:41:47 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:41:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:47 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Deleted allocations for instance 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d
Nov 15 14:41:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-19ca5936-927a-4dae-bad6-3e8ec9f91935 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.935s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-b9088b8c-f451-4be0-aa4c-a81aa7be47db req-df481f51-4e83-4d94-a957-74f9b1f765a4 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:41:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b9088b8c-f451-4be0-aa4c-a81aa7be47db req-df481f51-4e83-4d94-a957-74f9b1f765a4 service nova] Acquiring lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b9088b8c-f451-4be0-aa4c-a81aa7be47db req-df481f51-4e83-4d94-a957-74f9b1f765a4 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b9088b8c-f451-4be0-aa4c-a81aa7be47db req-df481f51-4e83-4d94-a957-74f9b1f765a4 service nova] Lock "9ae2fc25-ebaf-4ec6-aa39-024abc893e3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:47 user nova-compute[74892]: DEBUG nova.compute.manager [req-b9088b8c-f451-4be0-aa4c-a81aa7be47db req-df481f51-4e83-4d94-a957-74f9b1f765a4 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] No waiting events found dispatching network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:41:47 user nova-compute[74892]: WARNING nova.compute.manager [req-b9088b8c-f451-4be0-aa4c-a81aa7be47db req-df481f51-4e83-4d94-a957-74f9b1f765a4 service nova] [instance: 9ae2fc25-ebaf-4ec6-aa39-024abc893e3d] Received unexpected event network-vif-plugged-1932b387-4572-4580-a391-7f2a5791bf60 for instance with vm_state deleted and task_state None.
Nov 15 14:41:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-aa4b9283-c2bb-4b99-952c-24bbd7ad785e req-a925efd3-97b2-4e09-be8d-14d3a82e5c10 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-changed-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-aa4b9283-c2bb-4b99-952c-24bbd7ad785e req-a925efd3-97b2-4e09-be8d-14d3a82e5c10 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Refreshing instance network info cache due to event network-changed-db381515-87a5-4052-a816-a653d6860473. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-aa4b9283-c2bb-4b99-952c-24bbd7ad785e req-a925efd3-97b2-4e09-be8d-14d3a82e5c10 service nova] Acquiring lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-aa4b9283-c2bb-4b99-952c-24bbd7ad785e req-a925efd3-97b2-4e09-be8d-14d3a82e5c10 service nova] Acquired lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-aa4b9283-c2bb-4b99-952c-24bbd7ad785e req-a925efd3-97b2-4e09-be8d-14d3a82e5c10 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Refreshing network info cache for port db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-aa4b9283-c2bb-4b99-952c-24bbd7ad785e req-a925efd3-97b2-4e09-be8d-14d3a82e5c10 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updated VIF entry in instance network info cache for port db381515-87a5-4052-a816-a653d6860473. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-aa4b9283-c2bb-4b99-952c-24bbd7ad785e req-a925efd3-97b2-4e09-be8d-14d3a82e5c10 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updating instance_info_cache with network_info: [{"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-aa4b9283-c2bb-4b99-952c-24bbd7ad785e req-a925efd3-97b2-4e09-be8d-14d3a82e5c10 service nova] Releasing lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:41:57 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Updating instance_info_cache with network_info: [{"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:41:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:41:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:42:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8499MB free_disk=25.082672119140625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 9a85430d-53e3-4181-9588-158654fe008d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e15b92a9-d27c-41c3-b3da-a6419509fd8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:42:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:42:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:02 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:42:02 user nova-compute[74892]: INFO nova.compute.claims [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Claim successful on node user
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:42:03 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.policy [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c73da782783d41dbb370c3df04dec208', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cdd6323d06f4337995cbb796778b449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:42:03 user nova-compute[74892]: INFO nova.virt.block_device [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Booting with volume 91d1e699-ff30-4039-8a2f-01ca55bfb224 at /dev/vda
Nov 15 14:42:03 user nova-compute[74892]: DEBUG os_brick.utils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b737b5-c487-4163-b891-446d6a8de950]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[911409d3-9dfd-4177-9291-ec07e54c374e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd68eab-1f1d-411f-89a6-fa6a32649ce5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fae204-f1d0-4fc9-b07e-482b5a5c7187]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:42:03 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40d3d19-6e8b-4377-b4f8-150f68608f4d]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG os_brick.utils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updating existing volume attachment record: f3a47164-52c6-4be7-8a36-4ce5c401df45 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Successfully created port: 39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:03 user nova-compute[74892]: INFO nova.compute.manager [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attaching volume 968372e4-2185-4b1f-aa1d-12ee9d59229e to /dev/vdb
Nov 15 14:42:04 user nova-compute[74892]: DEBUG os_brick.utils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cad255-6715-4534-bddf-16eec3d59fd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aae324-75b8-42a2-8b4e-4d37376be1ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa93991-dc8a-4fdd-9e9d-1e5c33895257]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cfd2cc-30f9-451a-b17b-e9c867cd5598]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:42:04 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd56576-2147-4ee1-990b-e66e32481354]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG os_brick.utils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating existing volume attachment record: cc7d4ef4-e093-44c4-9da0-2a1b3b9ef8dd {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Successfully updated port: 39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquired lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-fb792a6c-cc96-4139-9b60-a530829bcd19 req-e04d5e8e-1be5-48e0-bc62-03d33df7257d service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-changed-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG nova.compute.manager [req-fb792a6c-cc96-4139-9b60-a530829bcd19 req-e04d5e8e-1be5-48e0-bc62-03d33df7257d service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Refreshing instance network info cache due to event network-changed-39a848b4-512d-49a6-827b-37e8501cb230. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fb792a6c-cc96-4139-9b60-a530829bcd19 req-e04d5e8e-1be5-48e0-bc62-03d33df7257d service nova] Acquiring lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:42:04 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG nova.network.neutron [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updating instance_info_cache with network_info: [{"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Releasing lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Instance network_info: |[{"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fb792a6c-cc96-4139-9b60-a530829bcd19 req-e04d5e8e-1be5-48e0-bc62-03d33df7257d service nova] Acquired lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG nova.network.neutron [req-fb792a6c-cc96-4139-9b60-a530829bcd19 req-e04d5e8e-1be5-48e0-bc62-03d33df7257d service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Refreshing network info cache for port 39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG nova.network.neutron [req-fb792a6c-cc96-4139-9b60-a530829bcd19 req-e04d5e8e-1be5-48e0-bc62-03d33df7257d service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updated VIF entry in instance network info cache for port 39a848b4-512d-49a6-827b-37e8501cb230. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG nova.network.neutron [req-fb792a6c-cc96-4139-9b60-a530829bcd19 req-e04d5e8e-1be5-48e0-bc62-03d33df7257d service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updating instance_info_cache with network_info: [{"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:42:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fb792a6c-cc96-4139-9b60-a530829bcd19 req-e04d5e8e-1be5-48e0-bc62-03d33df7257d service nova] Releasing lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:42:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:42:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:42:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:42:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Creating image(s)
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Ensure instance console log exists: /opt/stack/data/nova/instances/c8becb7f-db4c-423f-a831-c2de5fe8e4d5/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Start _get_guest_xml network_info=[{"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKxiFJvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c8becb7f-db4c-423f-a831-c2de5fe8e4d5', 'attached_at': '', 'detached_at': '', 'volume_id': '91d1e699-ff30-4039-8a2f-01ca55bfb224', 'serial': '91d1e699-ff30-4039-8a2f-01ca55bfb224'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'f3a47164-52c6-4be7-8a36-4ce5c401df45', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:42:08 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:42:08 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKxiFJvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:42:08 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:42:08 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:42:08 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b14957-d9f7-4283-9ef8-ae115ca30d95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:42:08 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1be2689-b8d5-466e-bca5-5d57aa8904f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224] added
Nov 15 14:42:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a481187b-9c6a-415e-b353-63033d092d9d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f0323f-980f-4630-8c44-2ee96085c827]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKxiFJvl {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fKxiFJvl" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ad164-e969-4ac5-a501-adfdd580226b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fKxiFJvl'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46e129a-4002-4021-85ee-349785b007e8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3b763c-aa11-4f80-b5e0-e04d117306c9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b3b6f3-fcbc-412f-9dc1-03cff7505440]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224, portal: 172.16.0.220,3260]
Nov 15 14:42:08 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224, portal: 172.16.0.220,3260] successful.
Nov 15 14:42:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a22df1-b8c4-4ca0-af2a-66e0ad61b3d4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4310b525-5093-4896-b8d5-1e02df7a53f9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:08 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:42:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:08 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:42:08 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[df51beba-210c-4ecd-b0d2-3b8e9f6874c8]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKxiFJvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayvUQqJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:42:08 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:42:08 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26539333131626539', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539333131626539', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.865s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:42:09 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:42:09 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe9ba7f-4218-4e7e-bf17-9b2211871e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-459248815',display_name='tempest-TestVolumeBootPattern-server-459248815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-459248815',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-ov8ymcou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:42:03Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=c8becb7f-db4c-423f-a831-c2de5fe8e4d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:d2:9a,bridge_name='br-int',has_traffic_filtering=True,id=39a848b4-512d-49a6-827b-37e8501cb230,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a848b4-51') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'pci_devices' on Instance uuid c8becb7f-db4c-423f-a831-c2de5fe8e4d5 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:42:09 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:42:09 user nova-compute[74892]:   <uuid>c8becb7f-db4c-423f-a831-c2de5fe8e4d5</uuid>
Nov 15 14:42:09 user nova-compute[74892]:   <name>instance-0000002f</name>
Nov 15 14:42:09 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:42:09 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:42:09 user nova-compute[74892]:   <metadata>
Nov 15 14:42:09 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:42:09 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:42:09 user nova-compute[74892]:       <nova:name>tempest-TestVolumeBootPattern-server-459248815</nova:name>
Nov 15 14:42:09 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:42:08</nova:creationTime>
Nov 15 14:42:09 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:42:09 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:42:09 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:42:09 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:42:09 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:42:09 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:42:09 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:42:09 user nova-compute[74892]:       <nova:owner>
Nov 15 14:42:09 user nova-compute[74892]:         <nova:user uuid="c73da782783d41dbb370c3df04dec208">tempest-TestVolumeBootPattern-1799633332-project-member</nova:user>
Nov 15 14:42:09 user nova-compute[74892]:         <nova:project uuid="1cdd6323d06f4337995cbb796778b449">tempest-TestVolumeBootPattern-1799633332</nova:project>
Nov 15 14:42:09 user nova-compute[74892]:       </nova:owner>
Nov 15 14:42:09 user nova-compute[74892]:       <nova:ports>
Nov 15 14:42:09 user nova-compute[74892]:         <nova:port uuid="39a848b4-512d-49a6-827b-37e8501cb230">
Nov 15 14:42:09 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 14:42:09 user nova-compute[74892]:         </nova:port>
Nov 15 14:42:09 user nova-compute[74892]:       </nova:ports>
Nov 15 14:42:09 user nova-compute[74892]:     </nova:instance>
Nov 15 14:42:09 user nova-compute[74892]:   </metadata>
Nov 15 14:42:09 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:42:09 user nova-compute[74892]:     <system>
Nov 15 14:42:09 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:42:09 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:42:09 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:42:09 user nova-compute[74892]:       <entry name="serial">c8becb7f-db4c-423f-a831-c2de5fe8e4d5</entry>
Nov 15 14:42:09 user nova-compute[74892]:       <entry name="uuid">c8becb7f-db4c-423f-a831-c2de5fe8e4d5</entry>
Nov 15 14:42:09 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:42:09 user nova-compute[74892]:     </system>
Nov 15 14:42:09 user nova-compute[74892]:   </sysinfo>
Nov 15 14:42:09 user nova-compute[74892]:   <os>
Nov 15 14:42:09 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:42:09 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:42:09 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:42:09 user nova-compute[74892]:   </os>
Nov 15 14:42:09 user nova-compute[74892]:   <features>
Nov 15 14:42:09 user nova-compute[74892]:     <acpi/>
Nov 15 14:42:09 user nova-compute[74892]:     <apic/>
Nov 15 14:42:09 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:42:09 user nova-compute[74892]:   </features>
Nov 15 14:42:09 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:42:09 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:42:09 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:42:09 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:42:09 user nova-compute[74892]:   </clock>
Nov 15 14:42:09 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:42:09 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:42:09 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:42:09 user nova-compute[74892]:   </cpu>
Nov 15 14:42:09 user nova-compute[74892]:   <devices>
Nov 15 14:42:09 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:42:09 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:42:09 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:42:09 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:42:09 user nova-compute[74892]:       <serial>91d1e699-ff30-4039-8a2f-01ca55bfb224</serial>
Nov 15 14:42:09 user nova-compute[74892]:     </disk>
Nov 15 14:42:09 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:42:09 user nova-compute[74892]:       <mac address="fa:16:3e:96:d2:9a"/>
Nov 15 14:42:09 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:42:09 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:42:09 user nova-compute[74892]:       <target dev="tap39a848b4-51"/>
Nov 15 14:42:09 user nova-compute[74892]:     </interface>
Nov 15 14:42:09 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:42:09 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/c8becb7f-db4c-423f-a831-c2de5fe8e4d5/console.log" append="off"/>
Nov 15 14:42:09 user nova-compute[74892]:     </serial>
Nov 15 14:42:09 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:42:09 user nova-compute[74892]:     <video>
Nov 15 14:42:09 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:42:09 user nova-compute[74892]:     </video>
Nov 15 14:42:09 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:42:09 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:42:09 user nova-compute[74892]:     </rng>
Nov 15 14:42:09 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:42:09 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:42:09 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:42:09 user nova-compute[74892]:     </memballoon>
Nov 15 14:42:09 user nova-compute[74892]:   </devices>
Nov 15 14:42:09 user nova-compute[74892]: </domain>
Nov 15 14:42:09 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-459248815',display_name='tempest-TestVolumeBootPattern-server-459248815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-459248815',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-ov8ymcou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:42:03Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=c8becb7f-db4c-423f-a831-c2de5fe8e4d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:d2:9a,bridge_name='br-int',has_traffic_filtering=True,id=39a848b4-512d-49a6-827b-37e8501cb230,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a848b4-51') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_vif [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:d2:9a,bridge_name='br-int',has_traffic_filtering=True,id=39a848b4-512d-49a6-827b-37e8501cb230,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a848b4-51') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b92024c5-82dc-592d-8b7e-a17a422b98cf', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f571a315-a62f-4d6b-a754-8ca00df92b55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e] added
Nov 15 14:42:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39a848b4-51, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39a848b4-51, col_values=(('qos', UUID('618c3540-babd-462c-9e33-f59a241d4c32')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39a848b4-51, col_values=(('external_ids', {'iface-id': '39a848b4-512d-49a6-827b-37e8501cb230', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:d2:9a', 'vm-uuid': 'c8becb7f-db4c-423f-a831-c2de5fe8e4d5'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:09 user nova-compute[74892]: INFO os_vif [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:d2:9a,bridge_name='br-int',has_traffic_filtering=True,id=39a848b4-512d-49a6-827b-37e8501cb230,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a848b4-51')
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911ed58-3bc8-4440-858c-e50897b44971]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.064s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e85c9f9-29c4-4a08-91d5-472bd5b8aa77]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ayvUQqJF {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ayvUQqJF" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f87a84-807c-4933-bf8b-98ed86a19c78]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ayvUQqJF'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] No VIF found with MAC fa:16:3e:96:d2:9a, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac66c62-c3cd-4bfa-8bc9-c679ffb7187f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6907732f-0996-485d-89b2-379817743baa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:09 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:42:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:09 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:42:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a307452-a903-42ea-9b7d-60af9513fbde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e, portal: 172.16.0.220,3260]
Nov 15 14:42:09 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e, portal: 172.16.0.220,3260] successful.
Nov 15 14:42:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8b8f02-39e5-4f77-940a-0cf78f6597db]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130631a-7b40-4e76-8102-630afc5086f0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:09 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:42:09 user nova-compute[74892]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e (non-flash)
Nov 15 14:42:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:09 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:42:09 user nova-compute[74892]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e (non-flash)
Nov 15 14:42:09 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0788d2f1-ea27-4542-b2f8-9cf0d7337579]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:42:09 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayvUQqJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:42:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:42:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== connect_volume: return (2246ms) {'type': 'block', 'scsi_wwn': '23965613531376164', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:42:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965613531376164', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:42:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:10 user nova-compute[74892]: DEBUG nova.objects.instance [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:42:10 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:42:10 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:42:10 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:42:10 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:42:10 user nova-compute[74892]:   <serial>968372e4-2185-4b1f-aa1d-12ee9d59229e</serial>
Nov 15 14:42:10 user nova-compute[74892]: </disk>
Nov 15 14:42:10 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3248fc9-3f41-45dc-9036-50d385f6e43d req-bf6527d0-aa6e-434d-a082-842b9afd3980 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3248fc9-3f41-45dc-9036-50d385f6e43d req-bf6527d0-aa6e-434d-a082-842b9afd3980 service nova] Acquiring lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3248fc9-3f41-45dc-9036-50d385f6e43d req-bf6527d0-aa6e-434d-a082-842b9afd3980 service nova] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3248fc9-3f41-45dc-9036-50d385f6e43d req-bf6527d0-aa6e-434d-a082-842b9afd3980 service nova] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3248fc9-3f41-45dc-9036-50d385f6e43d req-bf6527d0-aa6e-434d-a082-842b9afd3980 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] No waiting events found dispatching network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:42:11 user nova-compute[74892]: WARNING nova.compute.manager [req-c3248fc9-3f41-45dc-9036-50d385f6e43d req-bf6527d0-aa6e-434d-a082-842b9afd3980 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received unexpected event network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 for instance with vm_state building and task_state spawning.
Nov 15 14:42:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No VIF found with MAC fa:16:3e:cd:1e:14, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:42:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-0e9d8071-691e-4366-a9a8-aef4779e4dd5 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.872s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-b13a4ba4-cc35-41dc-bfed-ffbb93250342 req-3048879c-1321-4e50-848e-cb590d157c13 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b13a4ba4-cc35-41dc-bfed-ffbb93250342 req-3048879c-1321-4e50-848e-cb590d157c13 service nova] Acquiring lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b13a4ba4-cc35-41dc-bfed-ffbb93250342 req-3048879c-1321-4e50-848e-cb590d157c13 service nova] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b13a4ba4-cc35-41dc-bfed-ffbb93250342 req-3048879c-1321-4e50-848e-cb590d157c13 service nova] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-b13a4ba4-cc35-41dc-bfed-ffbb93250342 req-3048879c-1321-4e50-848e-cb590d157c13 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] No waiting events found dispatching network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:42:13 user nova-compute[74892]: WARNING nova.compute.manager [req-b13a4ba4-cc35-41dc-bfed-ffbb93250342 req-3048879c-1321-4e50-848e-cb590d157c13 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received unexpected event network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 for instance with vm_state building and task_state spawning.
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:42:13 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Instance spawned successfully.
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:42:13 user nova-compute[74892]: INFO nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 15 14:42:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:42:13 user nova-compute[74892]: INFO nova.compute.manager [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Took 10.87 seconds to build instance.
Nov 15 14:42:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-fcd3572a-c4a6-4c6b-bc8d-b285d4814879 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.155s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:14 user nova-compute[74892]: INFO nova.compute.manager [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Detaching volume 968372e4-2185-4b1f-aa1d-12ee9d59229e
Nov 15 14:42:14 user nova-compute[74892]: INFO nova.virt.block_device [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attempting to driver detach volume 968372e4-2185-4b1f-aa1d-12ee9d59229e from mountpoint /dev/vdb
Nov 15 14:42:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Attempting to detach device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:42:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:42:14 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:42:14 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:42:14 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:42:14 user nova-compute[74892]:   <serial>968372e4-2185-4b1f-aa1d-12ee9d59229e</serial>
Nov 15 14:42:14 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:42:14 user nova-compute[74892]: </disk>
Nov 15 14:42:14 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:42:14 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully detached device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the persistent domain config.
Nov 15 14:42:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:42:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:42:14 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:42:14 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:42:14 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:42:14 user nova-compute[74892]:   <serial>968372e4-2185-4b1f-aa1d-12ee9d59229e</serial>
Nov 15 14:42:14 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:42:14 user nova-compute[74892]: </disk>
Nov 15 14:42:14 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:42:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:42:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:34 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 is timed out.
Nov 15 14:42:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully detached device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the live domain config.
Nov 15 14:42:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ayvUQqJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:42:34 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a322aa9-2625-4c6d-9e0b-200b6b34903f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:42:34 user nova-compute[74892]: No targets found.
Nov 15 14:42:34 user nova-compute[74892]: iSNS:
Nov 15 14:42:34 user nova-compute[74892]: No targets found.
Nov 15 14:42:34 user nova-compute[74892]: STATIC:
Nov 15 14:42:34 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224
Nov 15 14:42:34 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:42:34 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:42:34 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e
Nov 15 14:42:34 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:42:34 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:42:34 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9
Nov 15 14:42:34 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:42:34 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:42:34 user nova-compute[74892]: FIRMWARE:
Nov 15 14:42:34 user nova-compute[74892]: No targets found.
Nov 15 14:42:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:42:34 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:42:34 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fad5dde-0efb-4394-8856-040c09476718]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c16595d-b8d5-4acf-9dee-a5301cdb3984]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:34 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:42:34 user nova-compute[74892]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e (non-flash)
Nov 15 14:42:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:42:34 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:42:34 user nova-compute[74892]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e (non-flash)
Nov 15 14:42:34 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd2016d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[533fe4ff-7088-4519-8e88-d947e7a23669]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7038a-359b-4f60-9228-2a7a080835a1]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb7d381-8b46-454b-8a3b-9f8481ff61e2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce765097-3300-427b-81ca-4bf72bbb48ba]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:34 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b881652d-b73c-4cc9-b375-a08e60d84f94]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b4fd00-1243-49d3-815c-b0e7ae3c9fe4]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e, portal: 172.16.0.220,3260]
Nov 15 14:42:35 user nova-compute[74892]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e, portal: 172.16.0.220,3260] successful.
Nov 15 14:42:35 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:968372e4-2185-4b1f-aa1d-12ee9d59229e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9036c9b-2491-4e49-a7e8-5a0d5af7ea33]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== disconnect_volume: return (266ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-df48b8e6-3576-4d35-81d0-47032081aa91 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.534s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9a85430d-53e3-4181-9588-158654fe008d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:40 user nova-compute[74892]: INFO nova.compute.manager [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Terminating instance
Nov 15 14:42:40 user nova-compute[74892]: DEBUG nova.compute.manager [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:42:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-1a8044a6-b14f-4132-984a-30de60f39ab7 req-c46b3510-41b2-4237-92a5-8682d7f336f7 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-unplugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1a8044a6-b14f-4132-984a-30de60f39ab7 req-c46b3510-41b2-4237-92a5-8682d7f336f7 service nova] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1a8044a6-b14f-4132-984a-30de60f39ab7 req-c46b3510-41b2-4237-92a5-8682d7f336f7 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1a8044a6-b14f-4132-984a-30de60f39ab7 req-c46b3510-41b2-4237-92a5-8682d7f336f7 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-1a8044a6-b14f-4132-984a-30de60f39ab7 req-c46b3510-41b2-4237-92a5-8682d7f336f7 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] No waiting events found dispatching network-vif-unplugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.compute.manager [req-1a8044a6-b14f-4132-984a-30de60f39ab7 req-c46b3510-41b2-4237-92a5-8682d7f336f7 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-unplugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Instance destroyed successfully.
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.objects.instance [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'resources' on Instance uuid 9a85430d-53e3-4181-9588-158654fe008d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-929193431',display_name='tempest-ServerRescueNegativeTestJSON-server-929193431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-929193431',id=31,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:28:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-r2c185fv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:28:40Z,user_data=None,user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=9a85430d-53e3-4181-9588-158654fe008d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "address": "fa:16:3e:74:40:37", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e7d8cf2-83", "ovs_interfaceid": "6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:40:37,bridge_name='br-int',has_traffic_filtering=True,id=6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7d8cf2-83') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG os_vif [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:40:37,bridge_name='br-int',has_traffic_filtering=True,id=6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7d8cf2-83') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e7d8cf2-83, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58e63465-7d5b-4174-a739-6b7646272ca3) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:41 user nova-compute[74892]: INFO os_vif [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:40:37,bridge_name='br-int',has_traffic_filtering=True,id=6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e7d8cf2-83')
Nov 15 14:42:41 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Deleting instance files /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d_del
Nov 15 14:42:41 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Deletion of /opt/stack/data/nova/instances/9a85430d-53e3-4181-9588-158654fe008d_del complete
Nov 15 14:42:41 user nova-compute[74892]: INFO nova.compute.manager [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 15 14:42:41 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 9a85430d-53e3-4181-9588-158654fe008d] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:42:41 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:42:41 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Took 0.43 seconds to deallocate network for instance.
Nov 15 14:42:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:42 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:42:42 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:42:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:42 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Deleted allocations for instance 9a85430d-53e3-4181-9588-158654fe008d
Nov 15 14:42:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-d8c94d6e-ce8c-4f56-842b-b451104980ef tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "9a85430d-53e3-4181-9588-158654fe008d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.573s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-333e8d28-5166-4a30-b550-243ff4214697 req-220506ba-dafd-4907-8764-f71c74e061d1 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:42:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-333e8d28-5166-4a30-b550-243ff4214697 req-220506ba-dafd-4907-8764-f71c74e061d1 service nova] Acquiring lock "9a85430d-53e3-4181-9588-158654fe008d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-333e8d28-5166-4a30-b550-243ff4214697 req-220506ba-dafd-4907-8764-f71c74e061d1 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-333e8d28-5166-4a30-b550-243ff4214697 req-220506ba-dafd-4907-8764-f71c74e061d1 service nova] Lock "9a85430d-53e3-4181-9588-158654fe008d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-333e8d28-5166-4a30-b550-243ff4214697 req-220506ba-dafd-4907-8764-f71c74e061d1 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] No waiting events found dispatching network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:42:43 user nova-compute[74892]: WARNING nova.compute.manager [req-333e8d28-5166-4a30-b550-243ff4214697 req-220506ba-dafd-4907-8764-f71c74e061d1 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received unexpected event network-vif-plugged-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b for instance with vm_state deleted and task_state None.
Nov 15 14:42:43 user nova-compute[74892]: DEBUG nova.compute.manager [req-333e8d28-5166-4a30-b550-243ff4214697 req-220506ba-dafd-4907-8764-f71c74e061d1 service nova] [instance: 9a85430d-53e3-4181-9588-158654fe008d] Received event network-vif-deleted-6e7d8cf2-8302-4a7c-8179-7aa9f0dc404b {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:42:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:42:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:42:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:42:58 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:42:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:42:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:42:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:42:58 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:42:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:42:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:42:59 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:43:00 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:43:00 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8432MB free_disk=25.092727661132812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e15b92a9-d27c-41c3-b3da-a6419509fd8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c8becb7f-db4c-423f-a831-c2de5fe8e4d5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:43:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:01 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:01 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:43:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:43:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:43:01 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:43:02 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating instance_info_cache with network_info: [{"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:43:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-3d2b2ed9-7627-4d26-a696-ce7a18e2f402" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:43:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:43:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:43:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG nova.objects.instance [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:06 user nova-compute[74892]: INFO nova.compute.manager [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attaching volume e59ea813-1ba2-4505-9921-1907bdd696a4 to /dev/vdb
Nov 15 14:43:06 user nova-compute[74892]: DEBUG os_brick.utils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a0dc7f-354a-4773-9a65-6218ac8b4f5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa8cbf-06c0-47f7-a56e-6c632419b680]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8745c6-c1ca-45d4-b904-d5782b4e7358]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[459f7298-b58c-4d9b-81b0-8a1cdb21542c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:43:06 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:43:06 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e5da7d-f46b-4fb2-91ca-b9d56e4c3e43]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG os_brick.utils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:43:06 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating existing volume attachment record: 2caa5bf4-cf7e-409d-87be-b7fa8520bfe8 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:43:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEBVKlmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:43:11 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:43:11 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:43:11 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[94580632-e1c1-4a57-bf58-50b3a0101355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:43:11 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2638a5-12aa-4968-b22e-818271378a4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4] added
Nov 15 14:43:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5856d69-ed26-4acc-bcfe-585eb2d71248]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[078346a2-e678-4947-b9c3-275eaa198ba0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEBVKlmy {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEBVKlmy" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[62164a68-a7f2-46d7-bc9b-20f8e73d833d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEBVKlmy'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[078dbe7a-dad2-44c1-a1c9-6a116dd01050]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[be95db26-6ed4-47a5-b32f-9a6b285e46a6]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c595b2b1-81e8-4f3b-8d53-70ae503a8a7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4, portal: 172.16.0.220,3260]
Nov 15 14:43:11 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4, portal: 172.16.0.220,3260] successful.
Nov 15 14:43:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfe9abd-a4fe-4b9a-b707-087389f18d27]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc975bb5-8665-480d-beee-58b2ca4a8cde]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 (non-flash)
Nov 15 14:43:11 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f13bcd-0b54-419c-86e9-a921f653f8a3]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:43:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEBVKlmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26139643936376561', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139643936376561', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:43:12 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:43:12 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:43:12 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:43:12 user nova-compute[74892]:   <serial>e59ea813-1ba2-4505-9921-1907bdd696a4</serial>
Nov 15 14:43:12 user nova-compute[74892]: </disk>
Nov 15 14:43:12 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:43:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] No VIF found with MAC fa:16:3e:cd:1e:14, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:43:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-aacfab8b-c946-4013-aea9-c090f2906a8c tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.526s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:15 user nova-compute[74892]: INFO nova.compute.manager [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Detaching volume e59ea813-1ba2-4505-9921-1907bdd696a4
Nov 15 14:43:15 user nova-compute[74892]: INFO nova.virt.block_device [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Attempting to driver detach volume e59ea813-1ba2-4505-9921-1907bdd696a4 from mountpoint /dev/vdb
Nov 15 14:43:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Attempting to detach device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:43:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:43:15 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:43:15 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:43:15 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:43:15 user nova-compute[74892]:   <serial>e59ea813-1ba2-4505-9921-1907bdd696a4</serial>
Nov 15 14:43:15 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:43:15 user nova-compute[74892]: </disk>
Nov 15 14:43:15 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:43:15 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully detached device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the persistent domain config.
Nov 15 14:43:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:43:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:43:15 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:43:15 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:43:15 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:43:15 user nova-compute[74892]:   <serial>e59ea813-1ba2-4505-9921-1907bdd696a4</serial>
Nov 15 14:43:15 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:43:15 user nova-compute[74892]: </disk>
Nov 15 14:43:15 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:43:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:43:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:19 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:43:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:43:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:43:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:31 user nova-compute[74892]: INFO nova.compute.manager [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Terminating instance
Nov 15 14:43:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ad3e56ab-e293-4c7a-9514-acaefa3dd061 req-ad0d1543-4592-499b-9edb-0bd64c78c26a service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ad3e56ab-e293-4c7a-9514-acaefa3dd061 req-ad0d1543-4592-499b-9edb-0bd64c78c26a service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ad3e56ab-e293-4c7a-9514-acaefa3dd061 req-ad0d1543-4592-499b-9edb-0bd64c78c26a service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ad3e56ab-e293-4c7a-9514-acaefa3dd061 req-ad0d1543-4592-499b-9edb-0bd64c78c26a service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ad3e56ab-e293-4c7a-9514-acaefa3dd061 req-ad0d1543-4592-499b-9edb-0bd64c78c26a service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:43:31 user nova-compute[74892]: DEBUG nova.compute.manager [req-ad3e56ab-e293-4c7a-9514-acaefa3dd061 req-ad0d1543-4592-499b-9edb-0bd64c78c26a service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-unplugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:43:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Instance destroyed successfully.
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.objects.instance [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lazy-loading 'resources' on Instance uuid 95ff8c73-db6f-4f15-a42f-83133b4fd7b1 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-768833210',display_name='tempest-ServerRescueNegativeTestJSON-server-768833210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-768833210',id=30,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16fe2666f7194df390f9764790c3663d',ramdisk_id='',reservation_id='r-yapgak5u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-454831858',owner_user_name='tempest-ServerRescueNegativeTestJSON-454831858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:33:20Z,user_data=None,user_id='29fa0ea399dc4bafb5d2926ae76261c3',uuid=95ff8c73-db6f-4f15-a42f-83133b4fd7b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converting VIF {"id": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "address": "fa:16:3e:00:5f:0d", "network": {"id": "c79ea199-e8bd-440c-842e-a4a86578b688", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-376335078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16fe2666f7194df390f9764790c3663d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c5a034-82", "ovs_interfaceid": "80c5a034-82fc-4eb0-8c8e-c5237b599138", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:5f:0d,bridge_name='br-int',has_traffic_filtering=True,id=80c5a034-82fc-4eb0-8c8e-c5237b599138,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c5a034-82') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG os_vif [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:5f:0d,bridge_name='br-int',has_traffic_filtering=True,id=80c5a034-82fc-4eb0-8c8e-c5237b599138,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c5a034-82') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80c5a034-82, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2810bb66-02eb-4a04-a6c6-cdb5a4dc526a) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:32 user nova-compute[74892]: INFO os_vif [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:5f:0d,bridge_name='br-int',has_traffic_filtering=True,id=80c5a034-82fc-4eb0-8c8e-c5237b599138,network=Network(c79ea199-e8bd-440c-842e-a4a86578b688),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c5a034-82')
Nov 15 14:43:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Deleting instance files /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1_del
Nov 15 14:43:32 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Deletion of /opt/stack/data/nova/instances/95ff8c73-db6f-4f15-a42f-83133b4fd7b1_del complete
Nov 15 14:43:32 user nova-compute[74892]: INFO nova.compute.manager [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Took 0.64 seconds to destroy the instance on the hypervisor.
Nov 15 14:43:32 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:43:32 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Took 0.43 seconds to deallocate network for instance.
Nov 15 14:43:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-61c802e5-1799-4a74-97bf-3963459fc62b req-0cbd363a-31af-439e-9efe-60b55f6edf20 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-deleted-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:43:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:32 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Deleted allocations for instance 95ff8c73-db6f-4f15-a42f-83133b4fd7b1
Nov 15 14:43:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-4cca2c19-ef35-491c-8ee3-4d72ca4ee157 tempest-ServerRescueNegativeTestJSON-454831858 tempest-ServerRescueNegativeTestJSON-454831858-project-member] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.496s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3929a5c-8f8b-4054-98b1-85593f7928e6 req-3ec9d117-7fd9-4686-be3a-122a8f6abac6 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:43:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3929a5c-8f8b-4054-98b1-85593f7928e6 req-3ec9d117-7fd9-4686-be3a-122a8f6abac6 service nova] Acquiring lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3929a5c-8f8b-4054-98b1-85593f7928e6 req-3ec9d117-7fd9-4686-be3a-122a8f6abac6 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e3929a5c-8f8b-4054-98b1-85593f7928e6 req-3ec9d117-7fd9-4686-be3a-122a8f6abac6 service nova] Lock "95ff8c73-db6f-4f15-a42f-83133b4fd7b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-e3929a5c-8f8b-4054-98b1-85593f7928e6 req-3ec9d117-7fd9-4686-be3a-122a8f6abac6 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] No waiting events found dispatching network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:43:33 user nova-compute[74892]: WARNING nova.compute.manager [req-e3929a5c-8f8b-4054-98b1-85593f7928e6 req-3ec9d117-7fd9-4686-be3a-122a8f6abac6 service nova] [instance: 95ff8c73-db6f-4f15-a42f-83133b4fd7b1] Received unexpected event network-vif-plugged-80c5a034-82fc-4eb0-8c8e-c5237b599138 for instance with vm_state deleted and task_state None.
Nov 15 14:43:36 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 is timed out.
Nov 15 14:43:36 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully detached device vdb from instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 from the live domain config.
Nov 15 14:43:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEBVKlmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:43:36 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abd7db1-ddad-4b7b-9f30-d020d017ce3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:43:36 user nova-compute[74892]: No targets found.
Nov 15 14:43:36 user nova-compute[74892]: iSNS:
Nov 15 14:43:36 user nova-compute[74892]: No targets found.
Nov 15 14:43:36 user nova-compute[74892]: STATIC:
Nov 15 14:43:36 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224
Nov 15 14:43:36 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:43:36 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:43:36 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9
Nov 15 14:43:36 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:43:36 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:43:36 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4
Nov 15 14:43:36 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:43:36 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:43:36 user nova-compute[74892]: FIRMWARE:
Nov 15 14:43:36 user nova-compute[74892]: No targets found.
Nov 15 14:43:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:43:36 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:43:36 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf967dbf-50b5-4b8f-a735-63431d182ab0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[77049501-3ff1-4a49-8f40-7747c2161bd1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:43:36 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:43:36 user nova-compute[74892]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 (non-flash)
Nov 15 14:43:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:43:36 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:43:36 user nova-compute[74892]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 (non-flash)
Nov 15 14:43:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20176d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[584f82a2-cc3f-4d2b-9b16-f1da376a4742]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[82133b4d-5102-43ed-b4b1-64308beecbc9]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[486a4eb2-ba85-43e4-a4d5-bcfbdd8be117]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8f0daa-6e34-4478-b065-4edf6f2d8e4a]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[875b9da1-3fa2-497d-b0fe-b708d16dd95a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec25fad7-17b7-46f1-9311-3811348206fd]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4, portal: 172.16.0.220,3260]
Nov 15 14:43:36 user nova-compute[74892]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4, portal: 172.16.0.220,3260] successful.
Nov 15 14:43:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59ea813-1ba2-4505-9921-1907bdd696a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cb7b34-28d4-4c60-8d4a-9a440e5f4038]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] <== disconnect_volume: return (320ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:43:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:43:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:37 user nova-compute[74892]: DEBUG nova.objects.instance [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'flavor' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:43:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-03503f39-44d4-4336-8aac-13486f658f48 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.672s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:43:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:43:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:43:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-26ed709f-6db6-47c6-bfe1-63b2fa333f74 req-8ac5ff8f-1643-4b07-8e2b-bc4eede42156 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-changed-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:43:54 user nova-compute[74892]: DEBUG nova.compute.manager [req-26ed709f-6db6-47c6-bfe1-63b2fa333f74 req-8ac5ff8f-1643-4b07-8e2b-bc4eede42156 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Refreshing instance network info cache due to event network-changed-39a848b4-512d-49a6-827b-37e8501cb230. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:43:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-26ed709f-6db6-47c6-bfe1-63b2fa333f74 req-8ac5ff8f-1643-4b07-8e2b-bc4eede42156 service nova] Acquiring lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:43:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-26ed709f-6db6-47c6-bfe1-63b2fa333f74 req-8ac5ff8f-1643-4b07-8e2b-bc4eede42156 service nova] Acquired lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:43:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-26ed709f-6db6-47c6-bfe1-63b2fa333f74 req-8ac5ff8f-1643-4b07-8e2b-bc4eede42156 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Refreshing network info cache for port 39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:43:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-26ed709f-6db6-47c6-bfe1-63b2fa333f74 req-8ac5ff8f-1643-4b07-8e2b-bc4eede42156 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updated VIF entry in instance network info cache for port 39a848b4-512d-49a6-827b-37e8501cb230. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:43:54 user nova-compute[74892]: DEBUG nova.network.neutron [req-26ed709f-6db6-47c6-bfe1-63b2fa333f74 req-8ac5ff8f-1643-4b07-8e2b-bc4eede42156 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updating instance_info_cache with network_info: [{"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:43:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-26ed709f-6db6-47c6-bfe1-63b2fa333f74 req-8ac5ff8f-1643-4b07-8e2b-bc4eede42156 service nova] Releasing lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-12634752-7b51-40da-b58d-7db2c6a65b6c req-87add3dc-e535-463d-9505-2761bbc10f2c service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-changed-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-12634752-7b51-40da-b58d-7db2c6a65b6c req-87add3dc-e535-463d-9505-2761bbc10f2c service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Refreshing instance network info cache due to event network-changed-39a848b4-512d-49a6-827b-37e8501cb230. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12634752-7b51-40da-b58d-7db2c6a65b6c req-87add3dc-e535-463d-9505-2761bbc10f2c service nova] Acquiring lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12634752-7b51-40da-b58d-7db2c6a65b6c req-87add3dc-e535-463d-9505-2761bbc10f2c service nova] Acquired lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG nova.network.neutron [req-12634752-7b51-40da-b58d-7db2c6a65b6c req-87add3dc-e535-463d-9505-2761bbc10f2c service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Refreshing network info cache for port 39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:55 user nova-compute[74892]: INFO nova.compute.manager [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Terminating instance
Nov 15 14:43:55 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:43:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG nova.network.neutron [req-12634752-7b51-40da-b58d-7db2c6a65b6c req-87add3dc-e535-463d-9505-2761bbc10f2c service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updated VIF entry in instance network info cache for port 39a848b4-512d-49a6-827b-37e8501cb230. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG nova.network.neutron [req-12634752-7b51-40da-b58d-7db2c6a65b6c req-87add3dc-e535-463d-9505-2761bbc10f2c service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updating instance_info_cache with network_info: [{"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12634752-7b51-40da-b58d-7db2c6a65b6c req-87add3dc-e535-463d-9505-2761bbc10f2c service nova] Releasing lock "refresh_cache-c8becb7f-db4c-423f-a831-c2de5fe8e4d5" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Instance destroyed successfully.
Nov 15 14:43:56 user nova-compute[74892]: DEBUG nova.objects.instance [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'resources' on Instance uuid c8becb7f-db4c-423f-a831-c2de5fe8e4d5 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-459248815',display_name='tempest-TestVolumeBootPattern-server-459248815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-459248815',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:42:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-ov8ymcou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:42:14Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=c8becb7f-db4c-423f-a831-c2de5fe8e4d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "39a848b4-512d-49a6-827b-37e8501cb230", "address": "fa:16:3e:96:d2:9a", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a848b4-51", "ovs_interfaceid": "39a848b4-512d-49a6-827b-37e8501cb230", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:d2:9a,bridge_name='br-int',has_traffic_filtering=True,id=39a848b4-512d-49a6-827b-37e8501cb230,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a848b4-51') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_vif [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:d2:9a,bridge_name='br-int',has_traffic_filtering=True,id=39a848b4-512d-49a6-827b-37e8501cb230,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a848b4-51') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39a848b4-51, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=618c3540-babd-462c-9e33-f59a241d4c32) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:43:56 user nova-compute[74892]: INFO os_vif [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:d2:9a,bridge_name='br-int',has_traffic_filtering=True,id=39a848b4-512d-49a6-827b-37e8501cb230,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a848b4-51')
Nov 15 14:43:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fKxiFJvl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:43:56 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ecbbff-a2f5-47d3-8b69-15584fde473e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:43:56 user nova-compute[74892]: No targets found.
Nov 15 14:43:56 user nova-compute[74892]: iSNS:
Nov 15 14:43:56 user nova-compute[74892]: No targets found.
Nov 15 14:43:56 user nova-compute[74892]: STATIC:
Nov 15 14:43:56 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224
Nov 15 14:43:56 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:43:56 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:43:56 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9
Nov 15 14:43:56 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:43:56 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:43:56 user nova-compute[74892]: FIRMWARE:
Nov 15 14:43:56 user nova-compute[74892]: No targets found.
Nov 15 14:43:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:43:56 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:43:56 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61153c7-7a74-4e79-bf42-0f8d10f38cdc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe9ae06-1c0f-4005-b5eb-ef28355de5ab]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:43:56 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:43:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:43:56 user nova-compute[74892]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 (non-flash)
Nov 15 14:43:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd005f0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a881720c-f94d-4586-86f8-d9a4cfae3dbb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f98c496-8cc2-475d-b24b-8abaec105379]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7202f81a-68dc-46e1-830f-7604fd98dbb5]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1989440-4d37-4de3-8334-f192a122c933]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6661f762-74d2-4e62-93de-bc5ae77a6af6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bda530-fa47-44fa-93c9-ce8317867f3a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224, portal: 172.16.0.220,3260]
Nov 15 14:43:56 user nova-compute[74892]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224, portal: 172.16.0.220,3260] successful.
Nov 15 14:43:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91d1e699-ff30-4039-8a2f-01ca55bfb224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1ca395-9553-4997-96e4-95fb0c9b2d00]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== disconnect_volume: return (282ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:43:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:43:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Deleting instance files /opt/stack/data/nova/instances/c8becb7f-db4c-423f-a831-c2de5fe8e4d5_del
Nov 15 14:43:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Deletion of /opt/stack/data/nova/instances/c8becb7f-db4c-423f-a831-c2de5fe8e4d5_del complete
Nov 15 14:43:57 user nova-compute[74892]: INFO nova.compute.manager [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 15 14:43:57 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:43:57 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Took 0.43 seconds to deallocate network for instance.
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-71c01fa7-63a0-414b-8d5c-8038668f3e5f req-c4e7d595-8655-4563-ab90-1805fd766fce service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-vif-deleted-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:43:57 user nova-compute[74892]: INFO nova.compute.manager [req-71c01fa7-63a0-414b-8d5c-8038668f3e5f req-c4e7d595-8655-4563-ab90-1805fd766fce service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Neutron deleted interface 39a848b4-512d-49a6-827b-37e8501cb230; detaching it from the instance and deleting it from the info cache
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.network.neutron [req-71c01fa7-63a0-414b-8d5c-8038668f3e5f req-c4e7d595-8655-4563-ab90-1805fd766fce service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-71c01fa7-63a0-414b-8d5c-8038668f3e5f req-c4e7d595-8655-4563-ab90-1805fd766fce service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Detach interface failed, port_id=39a848b4-512d-49a6-827b-37e8501cb230, reason: Instance c8becb7f-db4c-423f-a831-c2de5fe8e4d5 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-vif-unplugged-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] Acquiring lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] No waiting events found dispatching network-vif-unplugged-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-vif-unplugged-39a848b4-512d-49a6-827b-37e8501cb230 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received event network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] Acquiring lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] No waiting events found dispatching network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:43:57 user nova-compute[74892]: WARNING nova.compute.manager [req-37dea806-1213-4e76-89a4-76d45c653cb9 req-cc3efda2-fddf-4233-87b5-fe02761746b3 service nova] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Received unexpected event network-vif-plugged-39a848b4-512d-49a6-827b-37e8501cb230 for instance with vm_state active and task_state deleting.
Nov 15 14:43:58 user nova-compute[74892]: INFO nova.compute.manager [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: c8becb7f-db4c-423f-a831-c2de5fe8e4d5] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 14:43:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:43:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:43:58 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Deleted allocations for instance c8becb7f-db4c-423f-a831-c2de5fe8e4d5
Nov 15 14:43:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-9fd1ce72-a2b7-42e5-bea1-52133f722ef1 tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "c8becb7f-db4c-423f-a831-c2de5fe8e4d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.751s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:44:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:44:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:44:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:44:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8654MB free_disk=25.11945343017578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance e15b92a9-d27c-41c3-b3da-a6419509fd8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:44:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:44:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:44:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:44:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:44:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:44:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:44:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid e15b92a9-d27c-41c3-b3da-a6419509fd8f {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:44:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:21 user nova-compute[74892]: INFO nova.compute.manager [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Terminating instance
Nov 15 14:44:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-1c045c9c-b5ff-4503-8801-457c2ff77384 req-92d66990-1b7e-469c-bd0c-5b01b84e52e5 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-unplugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1c045c9c-b5ff-4503-8801-457c2ff77384 req-92d66990-1b7e-469c-bd0c-5b01b84e52e5 service nova] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1c045c9c-b5ff-4503-8801-457c2ff77384 req-92d66990-1b7e-469c-bd0c-5b01b84e52e5 service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1c045c9c-b5ff-4503-8801-457c2ff77384 req-92d66990-1b7e-469c-bd0c-5b01b84e52e5 service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-1c045c9c-b5ff-4503-8801-457c2ff77384 req-92d66990-1b7e-469c-bd0c-5b01b84e52e5 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] No waiting events found dispatching network-vif-unplugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-1c045c9c-b5ff-4503-8801-457c2ff77384 req-92d66990-1b7e-469c-bd0c-5b01b84e52e5 service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-unplugged-500820b5-a335-4501-ab44-3d994600fc78 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Instance destroyed successfully.
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lazy-loading 'resources' on Instance uuid 3d2b2ed9-7627-4d26-a696-ce7a18e2f402 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:37:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-944248390',display_name='tempest-SnapshotDataIntegrityTests-server-944248390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-944248390',id=44,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaNdWPd832yLSermuaruSQ9iUPnZIRASThpR3M/6RK2pzalwpGDzJ+O0LAXra9zoMrgzrzUPGaQUlXxE8QIUHcOHrVxBs9RPtF6OS2+/KW03QPptIXWOO6D7h302yIDyA==',key_name='tempest-keypair-579133522',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:38:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ec117ead6994cf4a27a81d82f1d7fc0',ramdisk_id='',reservation_id='r-8bhohghf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1644407710',owner_user_name='tempest-SnapshotDataIntegrityTests-1644407710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:38:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66f5d0ae0aeb4fac9c5c772544a74ee5',uuid=3d2b2ed9-7627-4d26-a696-ce7a18e2f402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Converting VIF {"id": "500820b5-a335-4501-ab44-3d994600fc78", "address": "fa:16:3e:cd:1e:14", "network": {"id": "26fa38e4-fab3-42d4-b63e-1a5f24aa5045", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1732480364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec117ead6994cf4a27a81d82f1d7fc0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500820b5-a3", "ovs_interfaceid": "500820b5-a335-4501-ab44-3d994600fc78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:1e:14,bridge_name='br-int',has_traffic_filtering=True,id=500820b5-a335-4501-ab44-3d994600fc78,network=Network(26fa38e4-fab3-42d4-b63e-1a5f24aa5045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500820b5-a3') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG os_vif [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:1e:14,bridge_name='br-int',has_traffic_filtering=True,id=500820b5-a335-4501-ab44-3d994600fc78,network=Network(26fa38e4-fab3-42d4-b63e-1a5f24aa5045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500820b5-a3') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap500820b5-a3, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45c4f64c-2377-4ddf-a1f9-0cd96082c6b2) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:22 user nova-compute[74892]: INFO os_vif [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:1e:14,bridge_name='br-int',has_traffic_filtering=True,id=500820b5-a335-4501-ab44-3d994600fc78,network=Network(26fa38e4-fab3-42d4-b63e-1a5f24aa5045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500820b5-a3')
Nov 15 14:44:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Deleting instance files /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402_del
Nov 15 14:44:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Deletion of /opt/stack/data/nova/instances/3d2b2ed9-7627-4d26-a696-ce7a18e2f402_del complete
Nov 15 14:44:22 user nova-compute[74892]: INFO nova.compute.manager [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 14:44:22 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:44:22 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:44:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] No waiting events found dispatching network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:24 user nova-compute[74892]: WARNING nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received unexpected event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 for instance with vm_state active and task_state deleting.
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] No waiting events found dispatching network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:24 user nova-compute[74892]: WARNING nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received unexpected event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 for instance with vm_state active and task_state deleting.
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] No waiting events found dispatching network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:24 user nova-compute[74892]: WARNING nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received unexpected event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 for instance with vm_state active and task_state deleting.
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-unplugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] No waiting events found dispatching network-vif-unplugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-unplugged-500820b5-a335-4501-ab44-3d994600fc78 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Acquiring lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] No waiting events found dispatching network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:24 user nova-compute[74892]: WARNING nova.compute.manager [req-abe18edd-ac49-434c-81e4-c4b58d011eb9 req-90d0b82d-da49-42e3-bc96-c9d9383df9be service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received unexpected event network-vif-plugged-500820b5-a335-4501-ab44-3d994600fc78 for instance with vm_state active and task_state deleting.
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:44:24 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Took 1.63 seconds to deallocate network for instance.
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-f6a440eb-d77a-4c5b-bea1-e55261aac086 req-253f488b-10b6-4d0c-8975-c50d5be9cf8c service nova] [instance: 3d2b2ed9-7627-4d26-a696-ce7a18e2f402] Received event network-vif-deleted-500820b5-a335-4501-ab44-3d994600fc78 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:24 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Deleted allocations for instance 3d2b2ed9-7627-4d26-a696-ce7a18e2f402
Nov 15 14:44:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1c287831-7b03-4f31-82db-8338a6620443 tempest-SnapshotDataIntegrityTests-1644407710 tempest-SnapshotDataIntegrityTests-1644407710-project-member] Lock "3d2b2ed9-7627-4d26-a696-ce7a18e2f402" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.044s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:44:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:42 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:42 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:44:42 user nova-compute[74892]: INFO nova.compute.claims [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Claim successful on node user
Nov 15 14:44:43 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:44:43 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:44:43 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG nova.policy [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1ca0e8ded8246cb975373043fcf350c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7d65ebc02a4198b310bdd6b9f28d58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:44:43 user nova-compute[74892]: INFO nova.virt.block_device [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Booting with volume 5b51ed4d-47a9-48c9-8311-82e6c3118c98 at /dev/vda
Nov 15 14:44:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bef8cc9-c133-4665-a984-f4d643bc5b19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5b1c4-7ebd-4bba-8364-141ddd8e1208]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed32fe8-4298-4a84-b8f7-56fe5bc523db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b357f339-90c5-4add-90e5-68d4c9a19305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:44:43 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:44:43 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b44659-50f3-4b86-9112-21cc503f0a95]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG os_brick.utils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:44:43 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating existing volume attachment record: 611eb1dd-84b8-455d-bca3-f8f4984b8264 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Successfully created port: 8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Successfully updated port: 8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-4bd45557-8754-4774-8bf6-1136a1c8a5a0 req-bc8a491f-20ea-4cfb-9d94-cda4b866ddf9 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG nova.compute.manager [req-4bd45557-8754-4774-8bf6-1136a1c8a5a0 req-bc8a491f-20ea-4cfb-9d94-cda4b866ddf9 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing instance network info cache due to event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4bd45557-8754-4774-8bf6-1136a1c8a5a0 req-bc8a491f-20ea-4cfb-9d94-cda4b866ddf9 service nova] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:44:44 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:44:45 user nova-compute[74892]: DEBUG nova.network.neutron [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:44:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:44:45 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance network_info: |[{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:44:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4bd45557-8754-4774-8bf6-1136a1c8a5a0 req-bc8a491f-20ea-4cfb-9d94-cda4b866ddf9 service nova] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:44:45 user nova-compute[74892]: DEBUG nova.network.neutron [req-4bd45557-8754-4774-8bf6-1136a1c8a5a0 req-bc8a491f-20ea-4cfb-9d94-cda4b866ddf9 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:44:45 user nova-compute[74892]: DEBUG nova.network.neutron [req-4bd45557-8754-4774-8bf6-1136a1c8a5a0 req-bc8a491f-20ea-4cfb-9d94-cda4b866ddf9 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updated VIF entry in instance network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:44:45 user nova-compute[74892]: DEBUG nova.network.neutron [req-4bd45557-8754-4774-8bf6-1136a1c8a5a0 req-bc8a491f-20ea-4cfb-9d94-cda4b866ddf9 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:44:45 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4bd45557-8754-4774-8bf6-1136a1c8a5a0 req-bc8a491f-20ea-4cfb-9d94-cda4b866ddf9 service nova] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:44:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:44:48 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Creating image(s)
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Ensure instance console log exists: /opt/stack/data/nova/instances/2e206998-f8e0-4fdf-8691-63dd3fd1d175/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Start _get_guest_xml network_info=[{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCelYbxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e206998-f8e0-4fdf-8691-63dd3fd1d175', 'attached_at': '', 'detached_at': '', 'volume_id': '5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'serial': '5b51ed4d-47a9-48c9-8311-82e6c3118c98'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '611eb1dd-84b8-455d-bca3-f8f4984b8264', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:44:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:44:48 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCelYbxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:44:48 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:44:48 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:44:48 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[393abb0c-275f-4417-b284-a0ca014a3607]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:44:48 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd1c0d-8151-435c-b5a8-8f562d9af9a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98] added
Nov 15 14:44:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[da57f260-c70a-4902-bdb6-07fb96f1af60]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e3e1b4-d7b3-47a8-a963-5af2726ee57b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCelYbxT {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCelYbxT" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3d496d-134d-487e-a8b5-8962a008b36a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yCelYbxT'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9f4015-178a-4f80-adc6-ade419115c4c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6352609-d16d-4aa0-b129-d8792e2aa8f5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:44:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:44:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa73799e-046f-45d5-ab0b-a6de4a52d619]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260]
Nov 15 14:44:48 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260] successful.
Nov 15 14:44:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc04fd-93d1-4adb-ba3a-2a0c562a8b04]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6024ca54-8c8f-4efc-abb4-0a9a8663bd5d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:44:48 user nova-compute[74892]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:44:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:44:48 user nova-compute[74892]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:44:48 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[71afb628-431f-4696-9367-04b772ecb663]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:48 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCelYbxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23033656534616139', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033656534616139', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2113330819',display_name='tempest-TestShelveInstance-server-2113330819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2113330819',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn1dGPaMJppoa7EXGzsStHTAfyndyKAglUq0QxuW1P1XJ4cjOq0PdcujBDU3xgzp9LuSoyF5KMmnACsBGklfPTafAvR6s+TWsXWV6dRc45cH76Si1RC7LFIqeIAcA4XnA==',key_name='tempest-TestShelveInstance-1733307534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d7d65ebc02a4198b310bdd6b9f28d58',ramdisk_id='',reservation_id='r-6avx5ypp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1148492158',owner_user_name='tempest-TestShelveInstance-1148492158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:44:43Z,user_data=None,user_id='d1ca0e8ded8246cb975373043fcf350c',uuid=2e206998-f8e0-4fdf-8691-63dd3fd1d175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converting VIF {"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e206998-f8e0-4fdf-8691-63dd3fd1d175 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:44:49 user nova-compute[74892]:   <uuid>2e206998-f8e0-4fdf-8691-63dd3fd1d175</uuid>
Nov 15 14:44:49 user nova-compute[74892]:   <name>instance-00000030</name>
Nov 15 14:44:49 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:44:49 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:44:49 user nova-compute[74892]:   <metadata>
Nov 15 14:44:49 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:44:49 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:44:49 user nova-compute[74892]:       <nova:name>tempest-TestShelveInstance-server-2113330819</nova:name>
Nov 15 14:44:49 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:44:48</nova:creationTime>
Nov 15 14:44:49 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:44:49 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:44:49 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:44:49 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:44:49 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:44:49 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:44:49 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:44:49 user nova-compute[74892]:       <nova:owner>
Nov 15 14:44:49 user nova-compute[74892]:         <nova:user uuid="d1ca0e8ded8246cb975373043fcf350c">tempest-TestShelveInstance-1148492158-project-member</nova:user>
Nov 15 14:44:49 user nova-compute[74892]:         <nova:project uuid="9d7d65ebc02a4198b310bdd6b9f28d58">tempest-TestShelveInstance-1148492158</nova:project>
Nov 15 14:44:49 user nova-compute[74892]:       </nova:owner>
Nov 15 14:44:49 user nova-compute[74892]:       <nova:ports>
Nov 15 14:44:49 user nova-compute[74892]:         <nova:port uuid="8b9592fd-597e-4615-aead-2f2da27a1780">
Nov 15 14:44:49 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:44:49 user nova-compute[74892]:         </nova:port>
Nov 15 14:44:49 user nova-compute[74892]:       </nova:ports>
Nov 15 14:44:49 user nova-compute[74892]:     </nova:instance>
Nov 15 14:44:49 user nova-compute[74892]:   </metadata>
Nov 15 14:44:49 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:44:49 user nova-compute[74892]:     <system>
Nov 15 14:44:49 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:44:49 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:44:49 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:44:49 user nova-compute[74892]:       <entry name="serial">2e206998-f8e0-4fdf-8691-63dd3fd1d175</entry>
Nov 15 14:44:49 user nova-compute[74892]:       <entry name="uuid">2e206998-f8e0-4fdf-8691-63dd3fd1d175</entry>
Nov 15 14:44:49 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:44:49 user nova-compute[74892]:     </system>
Nov 15 14:44:49 user nova-compute[74892]:   </sysinfo>
Nov 15 14:44:49 user nova-compute[74892]:   <os>
Nov 15 14:44:49 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:44:49 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:44:49 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:44:49 user nova-compute[74892]:   </os>
Nov 15 14:44:49 user nova-compute[74892]:   <features>
Nov 15 14:44:49 user nova-compute[74892]:     <acpi/>
Nov 15 14:44:49 user nova-compute[74892]:     <apic/>
Nov 15 14:44:49 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:44:49 user nova-compute[74892]:   </features>
Nov 15 14:44:49 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:44:49 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:44:49 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:44:49 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:44:49 user nova-compute[74892]:   </clock>
Nov 15 14:44:49 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:44:49 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:44:49 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:44:49 user nova-compute[74892]:   </cpu>
Nov 15 14:44:49 user nova-compute[74892]:   <devices>
Nov 15 14:44:49 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:44:49 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:44:49 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:44:49 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:44:49 user nova-compute[74892]:       <serial>5b51ed4d-47a9-48c9-8311-82e6c3118c98</serial>
Nov 15 14:44:49 user nova-compute[74892]:     </disk>
Nov 15 14:44:49 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:44:49 user nova-compute[74892]:       <mac address="fa:16:3e:53:ca:8b"/>
Nov 15 14:44:49 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:44:49 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:44:49 user nova-compute[74892]:       <target dev="tap8b9592fd-59"/>
Nov 15 14:44:49 user nova-compute[74892]:     </interface>
Nov 15 14:44:49 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:44:49 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/2e206998-f8e0-4fdf-8691-63dd3fd1d175/console.log" append="off"/>
Nov 15 14:44:49 user nova-compute[74892]:     </serial>
Nov 15 14:44:49 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:44:49 user nova-compute[74892]:     <video>
Nov 15 14:44:49 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:44:49 user nova-compute[74892]:     </video>
Nov 15 14:44:49 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:44:49 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:44:49 user nova-compute[74892]:     </rng>
Nov 15 14:44:49 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:44:49 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:44:49 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:44:49 user nova-compute[74892]:     </memballoon>
Nov 15 14:44:49 user nova-compute[74892]:   </devices>
Nov 15 14:44:49 user nova-compute[74892]: </domain>
Nov 15 14:44:49 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2113330819',display_name='tempest-TestShelveInstance-server-2113330819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2113330819',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn1dGPaMJppoa7EXGzsStHTAfyndyKAglUq0QxuW1P1XJ4cjOq0PdcujBDU3xgzp9LuSoyF5KMmnACsBGklfPTafAvR6s+TWsXWV6dRc45cH76Si1RC7LFIqeIAcA4XnA==',key_name='tempest-TestShelveInstance-1733307534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d7d65ebc02a4198b310bdd6b9f28d58',ramdisk_id='',reservation_id='r-6avx5ypp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1148492158',owner_user_name='tempest-TestShelveInstance-1148492158-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:44:43Z,user_data=None,user_id='d1ca0e8ded8246cb975373043fcf350c',uuid=2e206998-f8e0-4fdf-8691-63dd3fd1d175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converting VIF {"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG os_vif [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f8b4b0f-0005-5151-a970-4a53aa1b7c48', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b9592fd-59, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b9592fd-59, col_values=(('qos', UUID('27a69284-2945-4a7b-b401-de46bb3828f3')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b9592fd-59, col_values=(('external_ids', {'iface-id': '8b9592fd-597e-4615-aead-2f2da27a1780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ca:8b', 'vm-uuid': '2e206998-f8e0-4fdf-8691-63dd3fd1d175'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:49 user nova-compute[74892]: INFO os_vif [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59')
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:44:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] No VIF found with MAC fa:16:3e:53:ca:8b, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:44:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-c8dd066f-30d1-4b64-840c-ce6285877ec2 req-059cdf66-a7b6-46e6-82ef-b2a976490282 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8dd066f-30d1-4b64-840c-ce6285877ec2 req-059cdf66-a7b6-46e6-82ef-b2a976490282 service nova] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8dd066f-30d1-4b64-840c-ce6285877ec2 req-059cdf66-a7b6-46e6-82ef-b2a976490282 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8dd066f-30d1-4b64-840c-ce6285877ec2 req-059cdf66-a7b6-46e6-82ef-b2a976490282 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-c8dd066f-30d1-4b64-840c-ce6285877ec2 req-059cdf66-a7b6-46e6-82ef-b2a976490282 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] No waiting events found dispatching network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:51 user nova-compute[74892]: WARNING nova.compute.manager [req-c8dd066f-30d1-4b64-840c-ce6285877ec2 req-059cdf66-a7b6-46e6-82ef-b2a976490282 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received unexpected event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 for instance with vm_state building and task_state spawning.
Nov 15 14:44:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-93a2c846-d496-452f-9dc5-534d223ddf9b req-75aebd3a-83f4-404e-b2a3-924e585d3571 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-changed-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-93a2c846-d496-452f-9dc5-534d223ddf9b req-75aebd3a-83f4-404e-b2a3-924e585d3571 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Refreshing instance network info cache due to event network-changed-db381515-87a5-4052-a816-a653d6860473. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-93a2c846-d496-452f-9dc5-534d223ddf9b req-75aebd3a-83f4-404e-b2a3-924e585d3571 service nova] Acquiring lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-93a2c846-d496-452f-9dc5-534d223ddf9b req-75aebd3a-83f4-404e-b2a3-924e585d3571 service nova] Acquired lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG nova.network.neutron [req-93a2c846-d496-452f-9dc5-534d223ddf9b req-75aebd3a-83f4-404e-b2a3-924e585d3571 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Refreshing network info cache for port db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:51 user nova-compute[74892]: INFO nova.compute.manager [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Terminating instance
Nov 15 14:44:51 user nova-compute[74892]: DEBUG nova.compute.manager [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG nova.network.neutron [req-93a2c846-d496-452f-9dc5-534d223ddf9b req-75aebd3a-83f4-404e-b2a3-924e585d3571 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updated VIF entry in instance network info cache for port db381515-87a5-4052-a816-a653d6860473. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG nova.network.neutron [req-93a2c846-d496-452f-9dc5-534d223ddf9b req-75aebd3a-83f4-404e-b2a3-924e585d3571 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updating instance_info_cache with network_info: [{"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:44:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-93a2c846-d496-452f-9dc5-534d223ddf9b req-75aebd3a-83f4-404e-b2a3-924e585d3571 service nova] Releasing lock "refresh_cache-e15b92a9-d27c-41c3-b3da-a6419509fd8f" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Instance destroyed successfully.
Nov 15 14:44:52 user nova-compute[74892]: DEBUG nova.objects.instance [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lazy-loading 'resources' on Instance uuid e15b92a9-d27c-41c3-b3da-a6419509fd8f {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:40:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-500463630',display_name='tempest-TestVolumeBootPattern-server-500463630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-500463630',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKriDb4/ztHpBb8RLYj2+FUTVPRe5UBEgoToCgEGZijmi54xlUGRZm6hbuNByKcxdJAEUrxP3rh5RoACjfqUh19Enucmuw6ll56gAwxa9nEHl2hbdwBq/moC+9MoCL73nQ==',key_name='tempest-TestVolumeBootPattern-36926514',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:40:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cdd6323d06f4337995cbb796778b449',ramdisk_id='',reservation_id='r-cwkdwqo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1799633332',owner_user_name='tempest-TestVolumeBootPattern-1799633332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:40:16Z,user_data=None,user_id='c73da782783d41dbb370c3df04dec208',uuid=e15b92a9-d27c-41c3-b3da-a6419509fd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converting VIF {"id": "db381515-87a5-4052-a816-a653d6860473", "address": "fa:16:3e:9c:f4:60", "network": {"id": "a0840357-99cc-4a3d-895c-72919da12a53", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2095795872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cdd6323d06f4337995cbb796778b449", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb381515-87", "ovs_interfaceid": "db381515-87a5-4052-a816-a653d6860473", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:f4:60,bridge_name='br-int',has_traffic_filtering=True,id=db381515-87a5-4052-a816-a653d6860473,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb381515-87') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_vif [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:f4:60,bridge_name='br-int',has_traffic_filtering=True,id=db381515-87a5-4052-a816-a653d6860473,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb381515-87') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb381515-87, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efde1ab2-6d17-4b30-960c-555e03bafe11) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:44:52 user nova-compute[74892]: INFO os_vif [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:f4:60,bridge_name='br-int',has_traffic_filtering=True,id=db381515-87a5-4052-a816-a653d6860473,network=Network(a0840357-99cc-4a3d-895c-72919da12a53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb381515-87')
Nov 15 14:44:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRgGkCDi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:44:52 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[91124aec-d0ad-49a0-b425-fe2be11e9322]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:44:52 user nova-compute[74892]: No targets found.
Nov 15 14:44:52 user nova-compute[74892]: iSNS:
Nov 15 14:44:52 user nova-compute[74892]: No targets found.
Nov 15 14:44:52 user nova-compute[74892]: STATIC:
Nov 15 14:44:52 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9
Nov 15 14:44:52 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:44:52 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:44:52 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98
Nov 15 14:44:52 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:44:52 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:44:52 user nova-compute[74892]: FIRMWARE:
Nov 15 14:44:52 user nova-compute[74892]: No targets found.
Nov 15 14:44:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:44:52 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:44:52 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb5da1-d2f3-48d6-8277-46d38458cbaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b597beed-3a00-4a7c-b072-5c6558a538b1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:44:52 user nova-compute[74892]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:44:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 (non-flash)
Nov 15 14:44:52 user nova-compute[74892]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:44:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00629d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9'): ({'sdd'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Removing single pathed devices sdd {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eee3fa-54d2-428e-ba9e-1e5766818526]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7e40c9-c2f5-4ee4-a01b-c6eddd5d65e6]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Flushing IO for device /dev/sdd {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49c90aa-bc4a-4b92-8f88-34e35a3288e1]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3635612-658e-40e9-963c-5527e8131f23]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] SCSI volumes sdd have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOda3e7339-a9bd0d71fdf1b91a', '/dev/disk/by-id/scsi-26139626430643731', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_da3e7339') {{(pid=85038) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fff0026-19f8-4df9-ba15-98a96f7256b9]: (4, None) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e8714-ae8b-4576-9103-8339627409a8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ec3312-b79b-4deb-85cd-2df512d82583]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260]
Nov 15 14:44:52 user nova-compute[74892]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9, portal: 172.16.0.220,3260] successful.
Nov 15 14:44:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccb8a2b6-6730-43f4-bb8c-2e30855404a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03f870-1d5e-4624-bd4c-1359940d0cc8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] <== disconnect_volume: return (307ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:44:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Deleting instance files /opt/stack/data/nova/instances/e15b92a9-d27c-41c3-b3da-a6419509fd8f_del
Nov 15 14:44:52 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Deletion of /opt/stack/data/nova/instances/e15b92a9-d27c-41c3-b3da-a6419509fd8f_del complete
Nov 15 14:44:52 user nova-compute[74892]: INFO nova.compute.manager [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 15 14:44:52 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:44:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance spawned successfully.
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:44:53 user nova-compute[74892]: INFO nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:44:53 user nova-compute[74892]: INFO nova.compute.manager [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Took 10.39 seconds to build instance.
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a7f75a28-89af-4802-8545-e2fea0ecb323 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.493s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] No waiting events found dispatching network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:53 user nova-compute[74892]: WARNING nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received unexpected event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 for instance with vm_state active and task_state None.
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-vif-unplugged-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Acquiring lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] No waiting events found dispatching network-vif-unplugged-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-vif-unplugged-db381515-87a5-4052-a816-a653d6860473 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Acquiring lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] No waiting events found dispatching network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:44:53 user nova-compute[74892]: WARNING nova.compute.manager [req-5321730f-157b-4307-97bc-5404ef01d9c4 req-cade8070-2424-4ba5-a4d1-0e89e0b019e5 service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received unexpected event network-vif-plugged-db381515-87a5-4052-a816-a653d6860473 for instance with vm_state active and task_state deleting.
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:44:53 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Took 0.81 seconds to deallocate network for instance.
Nov 15 14:44:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-b062a0eb-e30c-4886-94d6-f12a5a0388c1 req-a1592f12-755a-4560-b8db-fdce697392ad service nova] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Received event network-vif-deleted-db381515-87a5-4052-a816-a653d6860473 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:44:54 user nova-compute[74892]: INFO nova.compute.manager [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] [instance: e15b92a9-d27c-41c3-b3da-a6419509fd8f] Took 0.98 seconds to detach 1 volumes for instance.
Nov 15 14:44:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:44:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:44:54 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:44:54 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:44:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:54 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Deleted allocations for instance e15b92a9-d27c-41c3-b3da-a6419509fd8f
Nov 15 14:44:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-11fb7115-cdce-4fd3-9a1f-757706945c8a tempest-TestVolumeBootPattern-1799633332 tempest-TestVolumeBootPattern-1799633332-project-member] Lock "e15b92a9-d27c-41c3-b3da-a6419509fd8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.356s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:44:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:44:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:45:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:45:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:45:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:45:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:45:00 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:45:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:45:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:45:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.135913848876953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2e206998-f8e0-4fdf-8691-63dd3fd1d175 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:45:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:45:02 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:45:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Updating instance_info_cache with network_info: [{"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:45:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-66ff4a98-ce8a-47ab-9ce5-a5384b2de323" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:45:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:45:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:45:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:45:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:45:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:45:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:45:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:45:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:45:34 user nova-compute[74892]: INFO nova.compute.manager [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Terminating instance
Nov 15 14:45:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-7d8226cf-d3c3-4d7b-a3d7-8b32c4ef0ee0 req-bc1b6b1d-e9c5-4ab8-bf89-47eb90b598ab service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received event network-vif-unplugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7d8226cf-d3c3-4d7b-a3d7-8b32c4ef0ee0 req-bc1b6b1d-e9c5-4ab8-bf89-47eb90b598ab service nova] Acquiring lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7d8226cf-d3c3-4d7b-a3d7-8b32c4ef0ee0 req-bc1b6b1d-e9c5-4ab8-bf89-47eb90b598ab service nova] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7d8226cf-d3c3-4d7b-a3d7-8b32c4ef0ee0 req-bc1b6b1d-e9c5-4ab8-bf89-47eb90b598ab service nova] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-7d8226cf-d3c3-4d7b-a3d7-8b32c4ef0ee0 req-bc1b6b1d-e9c5-4ab8-bf89-47eb90b598ab service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] No waiting events found dispatching network-vif-unplugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-7d8226cf-d3c3-4d7b-a3d7-8b32c4ef0ee0 req-bc1b6b1d-e9c5-4ab8-bf89-47eb90b598ab service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received event network-vif-unplugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:45:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Instance destroyed successfully.
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lazy-loading 'resources' on Instance uuid 66ff4a98-ce8a-47ab-9ce5-a5384b2de323 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:36:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1894120171',display_name='tempest-ServersNegativeTestJSON-server-1894120171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1894120171',id=42,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:36:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a8a34907a5846d68349968529f49dfc',ramdisk_id='',reservation_id='r-32b3k2pj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1366943078',owner_user_name='tempest-ServersNegativeTestJSON-1366943078-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:37:00Z,user_data=None,user_id='0502e4587dbc404da26bf5929fe2e3de',uuid=66ff4a98-ce8a-47ab-9ce5-a5384b2de323,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converting VIF {"id": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "address": "fa:16:3e:c3:d3:73", "network": {"id": "97c250b5-2837-44b0-8ce1-6a3c21e79ed8", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1623199269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8a34907a5846d68349968529f49dfc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f9132a-eb", "ovs_interfaceid": "f2f9132a-eb34-49a0-992e-69eceaf9bfb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:d3:73,bridge_name='br-int',has_traffic_filtering=True,id=f2f9132a-eb34-49a0-992e-69eceaf9bfb9,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f9132a-eb') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG os_vif [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:d3:73,bridge_name='br-int',has_traffic_filtering=True,id=f2f9132a-eb34-49a0-992e-69eceaf9bfb9,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f9132a-eb') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2f9132a-eb, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f93947e-7a11-4940-9820-c80e2902bfc3) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:45:35 user nova-compute[74892]: INFO os_vif [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:d3:73,bridge_name='br-int',has_traffic_filtering=True,id=f2f9132a-eb34-49a0-992e-69eceaf9bfb9,network=Network(97c250b5-2837-44b0-8ce1-6a3c21e79ed8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2f9132a-eb')
Nov 15 14:45:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Deleting instance files /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323_del
Nov 15 14:45:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Deletion of /opt/stack/data/nova/instances/66ff4a98-ce8a-47ab-9ce5-a5384b2de323_del complete
Nov 15 14:45:35 user nova-compute[74892]: INFO nova.compute.manager [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 14:45:35 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:45:35 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Took 0.42 seconds to deallocate network for instance.
Nov 15 14:45:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:45:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:45:36 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:45:36 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:45:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:45:36 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Deleted allocations for instance 66ff4a98-ce8a-47ab-9ce5-a5384b2de323
Nov 15 14:45:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1a7a7484-0617-4735-be18-9b1fe2f4a032 tempest-ServersNegativeTestJSON-1366943078 tempest-ServersNegativeTestJSON-1366943078-project-member] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.617s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:45:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-13670592-59ca-4c65-8760-2790e41d3bb4 req-2b8d1e1d-703f-4ed9-acdd-61fc4cceb10f service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received event network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:45:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-13670592-59ca-4c65-8760-2790e41d3bb4 req-2b8d1e1d-703f-4ed9-acdd-61fc4cceb10f service nova] Acquiring lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:45:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-13670592-59ca-4c65-8760-2790e41d3bb4 req-2b8d1e1d-703f-4ed9-acdd-61fc4cceb10f service nova] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:45:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-13670592-59ca-4c65-8760-2790e41d3bb4 req-2b8d1e1d-703f-4ed9-acdd-61fc4cceb10f service nova] Lock "66ff4a98-ce8a-47ab-9ce5-a5384b2de323-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:45:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-13670592-59ca-4c65-8760-2790e41d3bb4 req-2b8d1e1d-703f-4ed9-acdd-61fc4cceb10f service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] No waiting events found dispatching network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:45:37 user nova-compute[74892]: WARNING nova.compute.manager [req-13670592-59ca-4c65-8760-2790e41d3bb4 req-2b8d1e1d-703f-4ed9-acdd-61fc4cceb10f service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received unexpected event network-vif-plugged-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 for instance with vm_state deleted and task_state None.
Nov 15 14:45:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-13670592-59ca-4c65-8760-2790e41d3bb4 req-2b8d1e1d-703f-4ed9-acdd-61fc4cceb10f service nova] [instance: 66ff4a98-ce8a-47ab-9ce5-a5384b2de323] Received event network-vif-deleted-f2f9132a-eb34-49a0-992e-69eceaf9bfb9 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:45:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:45:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:45:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:46:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:00 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:46:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:46:00 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:46:00 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:46:00 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:46:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:46:01 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:46:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=25.16164779663086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2e206998-f8e0-4fdf-8691-63dd3fd1d175 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:46:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:46:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:46:03 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:03 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:46:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:46:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:46:03 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:46:04 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:46:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:46:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:46:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:46:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:46:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:46:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:46:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:46:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:46:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:46:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:46:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:46:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:46:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-5258207f-30c7-466c-b34b-08f0a0566ca7 req-8c9f7d9a-9e2a-40d2-a693-44d7d7e43743 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:46:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-5258207f-30c7-466c-b34b-08f0a0566ca7 req-8c9f7d9a-9e2a-40d2-a693-44d7d7e43743 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing instance network info cache due to event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:46:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5258207f-30c7-466c-b34b-08f0a0566ca7 req-8c9f7d9a-9e2a-40d2-a693-44d7d7e43743 service nova] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:46:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5258207f-30c7-466c-b34b-08f0a0566ca7 req-8c9f7d9a-9e2a-40d2-a693-44d7d7e43743 service nova] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:46:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-5258207f-30c7-466c-b34b-08f0a0566ca7 req-8c9f7d9a-9e2a-40d2-a693-44d7d7e43743 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:46:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-5258207f-30c7-466c-b34b-08f0a0566ca7 req-8c9f7d9a-9e2a-40d2-a693-44d7d7e43743 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updated VIF entry in instance network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:46:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-5258207f-30c7-466c-b34b-08f0a0566ca7 req-8c9f7d9a-9e2a-40d2-a693-44d7d7e43743 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5258207f-30c7-466c-b34b-08f0a0566ca7 req-8c9f7d9a-9e2a-40d2-a693-44d7d7e43743 service nova] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:46:35 user nova-compute[74892]: INFO nova.compute.manager [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Shelve offloading
Nov 15 14:46:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-a739fca4-8864-40fe-bf41-a6856812edf9 req-3628208f-fca7-4f9e-8f16-33a2dbb0d397 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-unplugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a739fca4-8864-40fe-bf41-a6856812edf9 req-3628208f-fca7-4f9e-8f16-33a2dbb0d397 service nova] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a739fca4-8864-40fe-bf41-a6856812edf9 req-3628208f-fca7-4f9e-8f16-33a2dbb0d397 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a739fca4-8864-40fe-bf41-a6856812edf9 req-3628208f-fca7-4f9e-8f16-33a2dbb0d397 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-a739fca4-8864-40fe-bf41-a6856812edf9 req-3628208f-fca7-4f9e-8f16-33a2dbb0d397 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] No waiting events found dispatching network-vif-unplugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:46:35 user nova-compute[74892]: WARNING nova.compute.manager [req-a739fca4-8864-40fe-bf41-a6856812edf9 req-3628208f-fca7-4f9e-8f16-33a2dbb0d397 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received unexpected event network-vif-unplugged-8b9592fd-597e-4615-aead-2f2da27a1780 for instance with vm_state active and task_state shelving.
Nov 15 14:46:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance destroyed successfully.
Nov 15 14:46:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:46:35 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.network.neutron [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:46:36 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance destroyed successfully.
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.objects.instance [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lazy-loading 'resources' on Instance uuid 2e206998-f8e0-4fdf-8691-63dd3fd1d175 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2113330819',display_name='tempest-TestShelveInstance-server-2113330819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2113330819',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn1dGPaMJppoa7EXGzsStHTAfyndyKAglUq0QxuW1P1XJ4cjOq0PdcujBDU3xgzp9LuSoyF5KMmnACsBGklfPTafAvR6s+TWsXWV6dRc45cH76Si1RC7LFIqeIAcA4XnA==',key_name='tempest-TestShelveInstance-1733307534',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:44:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d7d65ebc02a4198b310bdd6b9f28d58',ramdisk_id='',reservation_id='r-6avx5ypp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1148492158',owner_user_name='tempest-TestShelveInstance-1148492158-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:44:53Z,user_data=None,user_id='d1ca0e8ded8246cb975373043fcf350c',uuid=2e206998-f8e0-4fdf-8691-63dd3fd1d175,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converting VIF {"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_vif [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b9592fd-59, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-d2f1da53-c308-499c-bfb9-d78831f0027c req-e6f39c28-e334-4352-b4e2-1a95f4c7a7df service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-d2f1da53-c308-499c-bfb9-d78831f0027c req-e6f39c28-e334-4352-b4e2-1a95f4c7a7df service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing instance network info cache due to event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d2f1da53-c308-499c-bfb9-d78831f0027c req-e6f39c28-e334-4352-b4e2-1a95f4c7a7df service nova] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d2f1da53-c308-499c-bfb9-d78831f0027c req-e6f39c28-e334-4352-b4e2-1a95f4c7a7df service nova] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.network.neutron [req-d2f1da53-c308-499c-bfb9-d78831f0027c req-e6f39c28-e334-4352-b4e2-1a95f4c7a7df service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27a69284-2945-4a7b-b401-de46bb3828f3) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:46:36 user nova-compute[74892]: INFO os_vif [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59')
Nov 15 14:46:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCelYbxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:46:36 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5522f49-f49e-47e5-bcf5-1fb72a8b6187]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:46:36 user nova-compute[74892]: No targets found.
Nov 15 14:46:36 user nova-compute[74892]: iSNS:
Nov 15 14:46:36 user nova-compute[74892]: No targets found.
Nov 15 14:46:36 user nova-compute[74892]: STATIC:
Nov 15 14:46:36 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98
Nov 15 14:46:36 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:46:36 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:46:36 user nova-compute[74892]: FIRMWARE:
Nov 15 14:46:36 user nova-compute[74892]: No targets found.
Nov 15 14:46:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:46:36 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:46:36 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[384fd1fb-7bb2-4d8f-96cb-94a70e54e612]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e0cc8e-7ec1-413c-9f51-4f2b63477ed7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:46:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:46:36 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20176d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d82897-a340-4ae2-9782-0f07bb303471]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ad0178-be61-4431-b556-2c80bad9284e]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c88df2-9e41-4d1e-945f-2e64b170f02f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:46:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99e3a4c-df54-4ec3-a7b6-e23e176f06ce]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[554bda01-1ea6-4966-8ee4-ad02c953ac05]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b830f71e-9738-4e34-8298-cc37ff2f11ef]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260]
Nov 15 14:46:37 user nova-compute[74892]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260] successful.
Nov 15 14:46:37 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d70597-7f4b-436c-b28c-93ecd2aeef90]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] <== disconnect_volume: return (278ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:46:37 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Deleting instance files /opt/stack/data/nova/instances/2e206998-f8e0-4fdf-8691-63dd3fd1d175_del
Nov 15 14:46:37 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Deletion of /opt/stack/data/nova/instances/2e206998-f8e0-4fdf-8691-63dd3fd1d175_del complete
Nov 15 14:46:37 user nova-compute[74892]: DEBUG nova.network.neutron [req-d2f1da53-c308-499c-bfb9-d78831f0027c req-e6f39c28-e334-4352-b4e2-1a95f4c7a7df service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updated VIF entry in instance network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG nova.network.neutron [req-d2f1da53-c308-499c-bfb9-d78831f0027c req-e6f39c28-e334-4352-b4e2-1a95f4c7a7df service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": null, "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8b9592fd-59", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d2f1da53-c308-499c-bfb9-d78831f0027c req-e6f39c28-e334-4352-b4e2-1a95f4c7a7df service nova] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-ca13150a-8b2f-4719-a515-b74d9031f3ad req-cbdb5af9-5c9d-4fa0-b752-9238e5c6a682 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ca13150a-8b2f-4719-a515-b74d9031f3ad req-cbdb5af9-5c9d-4fa0-b752-9238e5c6a682 service nova] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ca13150a-8b2f-4719-a515-b74d9031f3ad req-cbdb5af9-5c9d-4fa0-b752-9238e5c6a682 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-ca13150a-8b2f-4719-a515-b74d9031f3ad req-cbdb5af9-5c9d-4fa0-b752-9238e5c6a682 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:46:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-ca13150a-8b2f-4719-a515-b74d9031f3ad req-cbdb5af9-5c9d-4fa0-b752-9238e5c6a682 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] No waiting events found dispatching network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:46:37 user nova-compute[74892]: WARNING nova.compute.manager [req-ca13150a-8b2f-4719-a515-b74d9031f3ad req-cbdb5af9-5c9d-4fa0-b752-9238e5c6a682 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received unexpected event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 for instance with vm_state active and task_state shelving.
Nov 15 14:46:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:38 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Deleted allocations for instance 2e206998-f8e0-4fdf-8691-63dd3fd1d175
Nov 15 14:46:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:46:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:46:38 user nova-compute[74892]: DEBUG nova.objects.instance [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e206998-f8e0-4fdf-8691-63dd3fd1d175 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:46:38 user nova-compute[74892]: DEBUG nova.objects.base [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Object Instance<2e206998-f8e0-4fdf-8691-63dd3fd1d175> lazy-loaded attributes: resources,numa_topology {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:46:38 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:46:38 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:46:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.095s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:46:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-f60371bd-3431-47ce-8ce1-7aa0fd152fe7 tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.197s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:46:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:46:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:46:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:47:02 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:47:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:47:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:47:02 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:47:03 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:47:03 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:47:03 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=25.151493072509766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:47:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:47:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:47:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:47:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:47:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:14 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:47:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:47:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:47:28 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:47:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:47:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:47:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:47:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:47:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:47:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:47:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:48:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:48:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:48:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:48:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:04 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:48:05 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:48:05 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:48:05 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=25.14849090576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:48:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:05 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:48:05 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:48:05 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:48:05 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:48:05 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:48:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:48:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:14 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:48:17 user nova-compute[74892]: INFO nova.compute.claims [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Claim successful on node user
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:48:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.policy [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd87bf1610b740e98fbb88b245301c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b93eb8ffe4a2f9ac702406fb1df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:48:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Creating image(s)
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "/opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "/opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "/opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "b9ec4204a30aceafd59ffff7966da48ac5dad51b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "b9ec4204a30aceafd59ffff7966da48ac5dad51b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:18 user nova-compute[74892]: DEBUG nova.virt.images [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] 7f67e253-f924-47bd-bbf2-9dcd0c0ce012 was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:48:18 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:48:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b.part /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:18 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Successfully created port: 54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b.part /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b.converted" returned: 0 in 0.425s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "b9ec4204a30aceafd59ffff7966da48ac5dad51b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.356s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "b9ec4204a30aceafd59ffff7966da48ac5dad51b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "b9ec4204a30aceafd59ffff7966da48ac5dad51b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Successfully updated port: 54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-d37d2c12-4bed-4278-ad05-ff721e31a4ed req-3c3bc724-781c-4794-8704-b4030ce438e7 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-d37d2c12-4bed-4278-ad05-ff721e31a4ed req-3c3bc724-781c-4794-8704-b4030ce438e7 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing instance network info cache due to event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d37d2c12-4bed-4278-ad05-ff721e31a4ed req-3c3bc724-781c-4794-8704-b4030ce438e7 service nova] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b,backing_fmt=raw /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b,backing_fmt=raw /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk 1073741824" returned: 0 in 0.060s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "b9ec4204a30aceafd59ffff7966da48ac5dad51b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Instance network_info: |[{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d37d2c12-4bed-4278-ad05-ff721e31a4ed req-3c3bc724-781c-4794-8704-b4030ce438e7 service nova] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:48:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-d37d2c12-4bed-4278-ad05-ff721e31a4ed req-3c3bc724-781c-4794-8704-b4030ce438e7 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Cannot resize image /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Ensure instance console log exists: /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Start _get_guest_xml network_info=[{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:48:14Z,direct_url=<?>,disk_format='qcow2',id=7f67e253-f924-47bd-bbf2-9dcd0c0ce012,min_disk=0,min_ram=0,name='tempest-scenario-img--408717069',owner='e82b93eb8ffe4a2f9ac702406fb1df88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:48:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '7f67e253-f924-47bd-bbf2-9dcd0c0ce012'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:48:20 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:48:20 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:48:14Z,direct_url=<?>,disk_format='qcow2',id=7f67e253-f924-47bd-bbf2-9dcd0c0ce012,min_disk=0,min_ram=0,name='tempest-scenario-img--408717069',owner='e82b93eb8ffe4a2f9ac702406fb1df88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:48:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-398515450',display_name='tempest-TestMinimumBasicScenario-server-398515450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-398515450',id=49,image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKXBSEUcUUjM+c/6DXEyeDoRu9sW++oIrxWLt2Glm3/CgxEC0XfGeZLW4jlg6pjb83+3q4ykt17mjRPCCBPAqZ6IWiqkA25Q6PCiojESRTF80uMzOFTtxd1rGqVxQ2Ntg==',key_name='tempest-TestMinimumBasicScenario-465543366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-rfrp3aye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:48:18Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=63270d07-97b5-4d60-87a4-5f467b1848ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.objects.instance [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'pci_devices' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:48:20 user nova-compute[74892]:   <uuid>63270d07-97b5-4d60-87a4-5f467b1848ce</uuid>
Nov 15 14:48:20 user nova-compute[74892]:   <name>instance-00000031</name>
Nov 15 14:48:20 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:48:20 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:48:20 user nova-compute[74892]:   <metadata>
Nov 15 14:48:20 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:48:20 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:48:20 user nova-compute[74892]:       <nova:name>tempest-TestMinimumBasicScenario-server-398515450</nova:name>
Nov 15 14:48:20 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:48:20</nova:creationTime>
Nov 15 14:48:20 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:48:20 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:48:20 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:48:20 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:48:20 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:48:20 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:48:20 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:48:20 user nova-compute[74892]:       <nova:owner>
Nov 15 14:48:20 user nova-compute[74892]:         <nova:user uuid="bd87bf1610b740e98fbb88b245301c56">tempest-TestMinimumBasicScenario-363938991-project-member</nova:user>
Nov 15 14:48:20 user nova-compute[74892]:         <nova:project uuid="e82b93eb8ffe4a2f9ac702406fb1df88">tempest-TestMinimumBasicScenario-363938991</nova:project>
Nov 15 14:48:20 user nova-compute[74892]:       </nova:owner>
Nov 15 14:48:20 user nova-compute[74892]:       <nova:root type="image" uuid="7f67e253-f924-47bd-bbf2-9dcd0c0ce012"/>
Nov 15 14:48:20 user nova-compute[74892]:       <nova:ports>
Nov 15 14:48:20 user nova-compute[74892]:         <nova:port uuid="54fccf43-8fcf-4679-9a9d-d4d118b17def">
Nov 15 14:48:20 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:48:20 user nova-compute[74892]:         </nova:port>
Nov 15 14:48:20 user nova-compute[74892]:       </nova:ports>
Nov 15 14:48:20 user nova-compute[74892]:     </nova:instance>
Nov 15 14:48:20 user nova-compute[74892]:   </metadata>
Nov 15 14:48:20 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:48:20 user nova-compute[74892]:     <system>
Nov 15 14:48:20 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:48:20 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:48:20 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:48:20 user nova-compute[74892]:       <entry name="serial">63270d07-97b5-4d60-87a4-5f467b1848ce</entry>
Nov 15 14:48:20 user nova-compute[74892]:       <entry name="uuid">63270d07-97b5-4d60-87a4-5f467b1848ce</entry>
Nov 15 14:48:20 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:48:20 user nova-compute[74892]:     </system>
Nov 15 14:48:20 user nova-compute[74892]:   </sysinfo>
Nov 15 14:48:20 user nova-compute[74892]:   <os>
Nov 15 14:48:20 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:48:20 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:48:20 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:48:20 user nova-compute[74892]:   </os>
Nov 15 14:48:20 user nova-compute[74892]:   <features>
Nov 15 14:48:20 user nova-compute[74892]:     <acpi/>
Nov 15 14:48:20 user nova-compute[74892]:     <apic/>
Nov 15 14:48:20 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:48:20 user nova-compute[74892]:   </features>
Nov 15 14:48:20 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:48:20 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:48:20 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:48:20 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:48:20 user nova-compute[74892]:   </clock>
Nov 15 14:48:20 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:48:20 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:48:20 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:48:20 user nova-compute[74892]:   </cpu>
Nov 15 14:48:20 user nova-compute[74892]:   <devices>
Nov 15 14:48:20 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:48:20 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:48:20 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk"/>
Nov 15 14:48:20 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:48:20 user nova-compute[74892]:     </disk>
Nov 15 14:48:20 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:48:20 user nova-compute[74892]:       <mac address="fa:16:3e:16:7a:42"/>
Nov 15 14:48:20 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:48:20 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:48:20 user nova-compute[74892]:       <target dev="tap54fccf43-8f"/>
Nov 15 14:48:20 user nova-compute[74892]:     </interface>
Nov 15 14:48:20 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:48:20 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/console.log" append="off"/>
Nov 15 14:48:20 user nova-compute[74892]:     </serial>
Nov 15 14:48:20 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:48:20 user nova-compute[74892]:     <video>
Nov 15 14:48:20 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:48:20 user nova-compute[74892]:     </video>
Nov 15 14:48:20 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:48:20 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:48:20 user nova-compute[74892]:     </rng>
Nov 15 14:48:20 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:48:20 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:48:20 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:48:20 user nova-compute[74892]:     </memballoon>
Nov 15 14:48:20 user nova-compute[74892]:   </devices>
Nov 15 14:48:20 user nova-compute[74892]: </domain>
Nov 15 14:48:20 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-398515450',display_name='tempest-TestMinimumBasicScenario-server-398515450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-398515450',id=49,image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKXBSEUcUUjM+c/6DXEyeDoRu9sW++oIrxWLt2Glm3/CgxEC0XfGeZLW4jlg6pjb83+3q4ykt17mjRPCCBPAqZ6IWiqkA25Q6PCiojESRTF80uMzOFTtxd1rGqVxQ2Ntg==',key_name='tempest-TestMinimumBasicScenario-465543366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-rfrp3aye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:48:18Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=63270d07-97b5-4d60-87a4-5f467b1848ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG os_vif [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7f5107e-1a15-59f8-8658-345fac2ef15b', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54fccf43-8f, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54fccf43-8f, col_values=(('qos', UUID('ecf6f920-1227-4be0-9cfa-7a7119f2ca68')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54fccf43-8f, col_values=(('external_ids', {'iface-id': '54fccf43-8fcf-4679-9a9d-d4d118b17def', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:7a:42', 'vm-uuid': '63270d07-97b5-4d60-87a4-5f467b1848ce'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:20 user nova-compute[74892]: INFO os_vif [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f')
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No VIF found with MAC fa:16:3e:16:7a:42, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.network.neutron [req-d37d2c12-4bed-4278-ad05-ff721e31a4ed req-3c3bc724-781c-4794-8704-b4030ce438e7 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updated VIF entry in instance network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG nova.network.neutron [req-d37d2c12-4bed-4278-ad05-ff721e31a4ed req-3c3bc724-781c-4794-8704-b4030ce438e7 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:48:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d37d2c12-4bed-4278-ad05-ff721e31a4ed req-3c3bc724-781c-4794-8704-b4030ce438e7 service nova] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:48:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-2a13f0b6-12d4-49ac-bb6b-d0ecca628d22 req-698fb61e-06a5-46fa-917b-be3b8d1e7fce service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:48:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a13f0b6-12d4-49ac-bb6b-d0ecca628d22 req-698fb61e-06a5-46fa-917b-be3b8d1e7fce service nova] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a13f0b6-12d4-49ac-bb6b-d0ecca628d22 req-698fb61e-06a5-46fa-917b-be3b8d1e7fce service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2a13f0b6-12d4-49ac-bb6b-d0ecca628d22 req-698fb61e-06a5-46fa-917b-be3b8d1e7fce service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-2a13f0b6-12d4-49ac-bb6b-d0ecca628d22 req-698fb61e-06a5-46fa-917b-be3b8d1e7fce service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] No waiting events found dispatching network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:48:21 user nova-compute[74892]: WARNING nova.compute.manager [req-2a13f0b6-12d4-49ac-bb6b-d0ecca628d22 req-698fb61e-06a5-46fa-917b-be3b8d1e7fce service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received unexpected event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def for instance with vm_state building and task_state spawning.
Nov 15 14:48:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-7000d8b9-0f28-4b3b-a6ca-d3822a91f989 req-a9bd1433-43d3-42d4-84ce-80ae8fe27a2e service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7000d8b9-0f28-4b3b-a6ca-d3822a91f989 req-a9bd1433-43d3-42d4-84ce-80ae8fe27a2e service nova] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7000d8b9-0f28-4b3b-a6ca-d3822a91f989 req-a9bd1433-43d3-42d4-84ce-80ae8fe27a2e service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7000d8b9-0f28-4b3b-a6ca-d3822a91f989 req-a9bd1433-43d3-42d4-84ce-80ae8fe27a2e service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-7000d8b9-0f28-4b3b-a6ca-d3822a91f989 req-a9bd1433-43d3-42d4-84ce-80ae8fe27a2e service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] No waiting events found dispatching network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:48:23 user nova-compute[74892]: WARNING nova.compute.manager [req-7000d8b9-0f28-4b3b-a6ca-d3822a91f989 req-a9bd1433-43d3-42d4-84ce-80ae8fe27a2e service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received unexpected event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def for instance with vm_state building and task_state spawning.
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:48:23 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Instance spawned successfully.
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:48:23 user nova-compute[74892]: INFO nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 15 14:48:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:48:24 user nova-compute[74892]: INFO nova.compute.manager [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Took 6.64 seconds to build instance.
Nov 15 14:48:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2891fd71-477f-4b14-b227-3d3cb2ea20f6 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.741s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:48:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:48:26 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:48:26 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:27 user nova-compute[74892]: INFO nova.compute.manager [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Unshelving
Nov 15 14:48:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:27 user nova-compute[74892]: INFO nova.virt.block_device [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Booting with volume 5b51ed4d-47a9-48c9-8311-82e6c3118c98 at /dev/vda
Nov 15 14:48:27 user nova-compute[74892]: DEBUG os_brick.utils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84410a4-6cba-471e-8b70-935f0ead61e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae18e5-c3e2-44f8-8d4e-1f4854f873d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8111496a-e673-4326-84bd-54baf3c42601]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dadd8ad-40c0-4661-b27a-d32e00c411a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:48:27 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:48:27 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6cc5ef-17d4-4572-9caf-e091bfb7b696]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG os_brick.utils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:48:27 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating existing volume attachment record: 35768a6c-5b5d-43ad-9c4f-d94de5064233 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:48:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:32 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lazy-loading 'pci_requests' on Instance uuid 2e206998-f8e0-4fdf-8691-63dd3fd1d175 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:48:32 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lazy-loading 'numa_topology' on Instance uuid 2e206998-f8e0-4fdf-8691-63dd3fd1d175 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:48:32 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:48:32 user nova-compute[74892]: INFO nova.compute.claims [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Claim successful on node user
Nov 15 14:48:32 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:48:32 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:48:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:32 user nova-compute[74892]: INFO nova.network.neutron [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating port 8b9592fd-597e-4615-aead-2f2da27a1780 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-12396f29-f692-46a8-9582-a1737538ecd2 req-09911113-8b51-4b90-83cf-d195020aac30 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-12396f29-f692-46a8-9582-a1737538ecd2 req-09911113-8b51-4b90-83cf-d195020aac30 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing instance network info cache due to event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12396f29-f692-46a8-9582-a1737538ecd2 req-09911113-8b51-4b90-83cf-d195020aac30 service nova] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:48:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Creating image(s)
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Did not create local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Ensure instance console log exists: /opt/stack/data/nova/instances/2e206998-f8e0-4fdf-8691-63dd3fd1d175/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Start _get_guest_xml network_info=[{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCelYbxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2e206998-f8e0-4fdf-8691-63dd3fd1d175', 'attached_at': '', 'detached_at': '', 'volume_id': '5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'serial': '5b51ed4d-47a9-48c9-8311-82e6c3118c98'}, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '35768a6c-5b5d-43ad-9c4f-d94de5064233', 'delete_on_termination': True, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12396f29-f692-46a8-9582-a1737538ecd2 req-09911113-8b51-4b90-83cf-d195020aac30 service nova] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.network.neutron [req-12396f29-f692-46a8-9582-a1737538ecd2 req-09911113-8b51-4b90-83cf-d195020aac30 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:48:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:48:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2e206998-f8e0-4fdf-8691-63dd3fd1d175 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.objects.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Object Instance<2e206998-f8e0-4fdf-8691-63dd3fd1d175> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCelYbxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:48:33 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:48:33 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:48:33 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1fe38b-4b24-4705-8a58-fdef33712ec4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:48:33 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ca606-24cd-46ee-943c-d32fd3d4cc67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98] added
Nov 15 14:48:33 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9de505-3dd5-4e48-b3db-55c92d795076]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d63db-b0c4-4c18-9bf0-f733da07cad9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCelYbxT {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yCelYbxT" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfbc1ce-16aa-4363-9e9d-93409a2f401b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yCelYbxT'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4106e7f-0451-4563-90dc-c71162dcd9a4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31a191c-8ba3-45c6-a833-06e5058d0ef6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:48:33 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:48:33 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:48:33 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 14:48:33 user nova-compute[74892]: 
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7edc7e-a480-42a0-a580-573d01086083]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260]
Nov 15 14:48:33 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260] successful.
Nov 15 14:48:33 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b92ba-9ed6-4904-ad5f-a3e1c7c169e2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e97995-c60e-40e1-a4b8-21d95cfae858]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:48:33 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:48:33 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a12dd1-636a-4a65-82b6-43ac26108d45]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:48:33 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCelYbxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:48:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-12396f29-f692-46a8-9582-a1737538ecd2 req-09911113-8b51-4b90-83cf-d195020aac30 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updated VIF entry in instance network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:48:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-12396f29-f692-46a8-9582-a1737538ecd2 req-09911113-8b51-4b90-83cf-d195020aac30 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:48:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12396f29-f692-46a8-9582-a1737538ecd2 req-09911113-8b51-4b90-83cf-d195020aac30 service nova] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23033656534616139', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033656534616139', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2113330819',display_name='tempest-TestShelveInstance-server-2113330819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2113330819',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1733307534',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:44:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9d7d65ebc02a4198b310bdd6b9f28d58',ramdisk_id='',reservation_id='r-6avx5ypp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1148492158',owner_user_name='tempest-TestShelveInstance-1148492158-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:48:27Z,user_data=None,user_id='d1ca0e8ded8246cb975373043fcf350c',uuid=2e206998-f8e0-4fdf-8691-63dd3fd1d175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converting VIF {"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.objects.instance [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e206998-f8e0-4fdf-8691-63dd3fd1d175 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.objects.base [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Object Instance<2e206998-f8e0-4fdf-8691-63dd3fd1d175> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:48:35 user nova-compute[74892]:   <uuid>2e206998-f8e0-4fdf-8691-63dd3fd1d175</uuid>
Nov 15 14:48:35 user nova-compute[74892]:   <name>instance-00000030</name>
Nov 15 14:48:35 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:48:35 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:48:35 user nova-compute[74892]:   <metadata>
Nov 15 14:48:35 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:48:35 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:48:35 user nova-compute[74892]:       <nova:name>tempest-TestShelveInstance-server-2113330819</nova:name>
Nov 15 14:48:35 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:48:33</nova:creationTime>
Nov 15 14:48:35 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:48:35 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:48:35 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:48:35 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:48:35 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:48:35 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:48:35 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:48:35 user nova-compute[74892]:       <nova:owner>
Nov 15 14:48:35 user nova-compute[74892]:         <nova:user uuid="d1ca0e8ded8246cb975373043fcf350c">tempest-TestShelveInstance-1148492158-project-member</nova:user>
Nov 15 14:48:35 user nova-compute[74892]:         <nova:project uuid="9d7d65ebc02a4198b310bdd6b9f28d58">tempest-TestShelveInstance-1148492158</nova:project>
Nov 15 14:48:35 user nova-compute[74892]:       </nova:owner>
Nov 15 14:48:35 user nova-compute[74892]:       <nova:ports>
Nov 15 14:48:35 user nova-compute[74892]:         <nova:port uuid="8b9592fd-597e-4615-aead-2f2da27a1780">
Nov 15 14:48:35 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 14:48:35 user nova-compute[74892]:         </nova:port>
Nov 15 14:48:35 user nova-compute[74892]:       </nova:ports>
Nov 15 14:48:35 user nova-compute[74892]:     </nova:instance>
Nov 15 14:48:35 user nova-compute[74892]:   </metadata>
Nov 15 14:48:35 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:48:35 user nova-compute[74892]:     <system>
Nov 15 14:48:35 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:48:35 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:48:35 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:48:35 user nova-compute[74892]:       <entry name="serial">2e206998-f8e0-4fdf-8691-63dd3fd1d175</entry>
Nov 15 14:48:35 user nova-compute[74892]:       <entry name="uuid">2e206998-f8e0-4fdf-8691-63dd3fd1d175</entry>
Nov 15 14:48:35 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:48:35 user nova-compute[74892]:     </system>
Nov 15 14:48:35 user nova-compute[74892]:   </sysinfo>
Nov 15 14:48:35 user nova-compute[74892]:   <os>
Nov 15 14:48:35 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:48:35 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:48:35 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:48:35 user nova-compute[74892]:   </os>
Nov 15 14:48:35 user nova-compute[74892]:   <features>
Nov 15 14:48:35 user nova-compute[74892]:     <acpi/>
Nov 15 14:48:35 user nova-compute[74892]:     <apic/>
Nov 15 14:48:35 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:48:35 user nova-compute[74892]:   </features>
Nov 15 14:48:35 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:48:35 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:48:35 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:48:35 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:48:35 user nova-compute[74892]:   </clock>
Nov 15 14:48:35 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:48:35 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:48:35 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:48:35 user nova-compute[74892]:   </cpu>
Nov 15 14:48:35 user nova-compute[74892]:   <devices>
Nov 15 14:48:35 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:48:35 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:48:35 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:48:35 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:48:35 user nova-compute[74892]:       <serial>5b51ed4d-47a9-48c9-8311-82e6c3118c98</serial>
Nov 15 14:48:35 user nova-compute[74892]:     </disk>
Nov 15 14:48:35 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:48:35 user nova-compute[74892]:       <mac address="fa:16:3e:53:ca:8b"/>
Nov 15 14:48:35 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:48:35 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:48:35 user nova-compute[74892]:       <target dev="tap8b9592fd-59"/>
Nov 15 14:48:35 user nova-compute[74892]:     </interface>
Nov 15 14:48:35 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:48:35 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/2e206998-f8e0-4fdf-8691-63dd3fd1d175/console.log" append="off"/>
Nov 15 14:48:35 user nova-compute[74892]:     </serial>
Nov 15 14:48:35 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:48:35 user nova-compute[74892]:     <video>
Nov 15 14:48:35 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:48:35 user nova-compute[74892]:     </video>
Nov 15 14:48:35 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:48:35 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:48:35 user nova-compute[74892]:     </rng>
Nov 15 14:48:35 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:48:35 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:48:35 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:48:35 user nova-compute[74892]:     </memballoon>
Nov 15 14:48:35 user nova-compute[74892]:   </devices>
Nov 15 14:48:35 user nova-compute[74892]: </domain>
Nov 15 14:48:35 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2113330819',display_name='tempest-TestShelveInstance-server-2113330819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2113330819',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1733307534',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:44:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9d7d65ebc02a4198b310bdd6b9f28d58',ramdisk_id='',reservation_id='r-6avx5ypp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1148492158',owner_user_name='tempest-TestShelveInstance-1148492158-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:48:27Z,user_data=None,user_id='d1ca0e8ded8246cb975373043fcf350c',uuid=2e206998-f8e0-4fdf-8691-63dd3fd1d175,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converting VIF {"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG os_vif [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f8b4b0f-0005-5151-a970-4a53aa1b7c48', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b9592fd-59, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b9592fd-59, col_values=(('qos', UUID('c9db8aa1-c7d6-4a66-bac4-4c38a9bd4359')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b9592fd-59, col_values=(('external_ids', {'iface-id': '8b9592fd-597e-4615-aead-2f2da27a1780', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ca:8b', 'vm-uuid': '2e206998-f8e0-4fdf-8691-63dd3fd1d175'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:35 user nova-compute[74892]: INFO os_vif [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59')
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:48:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] No VIF found with MAC fa:16:3e:53:ca:8b, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-b855110f-dc32-4f2e-895c-328e209d9220 req-e91e1303-87c7-4611-b209-bca0f2d73ed6 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b855110f-dc32-4f2e-895c-328e209d9220 req-e91e1303-87c7-4611-b209-bca0f2d73ed6 service nova] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b855110f-dc32-4f2e-895c-328e209d9220 req-e91e1303-87c7-4611-b209-bca0f2d73ed6 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b855110f-dc32-4f2e-895c-328e209d9220 req-e91e1303-87c7-4611-b209-bca0f2d73ed6 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG nova.compute.manager [req-b855110f-dc32-4f2e-895c-328e209d9220 req-e91e1303-87c7-4611-b209-bca0f2d73ed6 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] No waiting events found dispatching network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:48:36 user nova-compute[74892]: WARNING nova.compute.manager [req-b855110f-dc32-4f2e-895c-328e209d9220 req-e91e1303-87c7-4611-b209-bca0f2d73ed6 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received unexpected event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 14:48:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:38 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:48:38 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:48:38 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance spawned successfully.
Nov 15 14:48:38 user nova-compute[74892]: DEBUG nova.compute.manager [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:48:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-4cf392ca-5916-4c5d-a3c6-14f0fb6bda14 req-57a71de6-7d6e-4391-9088-985838726ae2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:48:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4cf392ca-5916-4c5d-a3c6-14f0fb6bda14 req-57a71de6-7d6e-4391-9088-985838726ae2 service nova] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:48:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4cf392ca-5916-4c5d-a3c6-14f0fb6bda14 req-57a71de6-7d6e-4391-9088-985838726ae2 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:48:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4cf392ca-5916-4c5d-a3c6-14f0fb6bda14 req-57a71de6-7d6e-4391-9088-985838726ae2 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:38 user nova-compute[74892]: DEBUG nova.compute.manager [req-4cf392ca-5916-4c5d-a3c6-14f0fb6bda14 req-57a71de6-7d6e-4391-9088-985838726ae2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] No waiting events found dispatching network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:48:38 user nova-compute[74892]: WARNING nova.compute.manager [req-4cf392ca-5916-4c5d-a3c6-14f0fb6bda14 req-57a71de6-7d6e-4391-9088-985838726ae2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received unexpected event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 14:48:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-1e5fb2f9-b01c-4680-9789-e70809e11b8e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.410s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:48:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:48:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:05 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:49:05 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:49:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:49:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:49:05 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:49:05 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:49:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:49:07 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:49:07 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=25.056598663330078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 63270d07-97b5-4d60-87a4-5f467b1848ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2e206998-f8e0-4fdf-8691-63dd3fd1d175 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:49:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:49:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:49:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:12 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:49:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:49:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:49:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:32 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:49:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:49:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:49:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:49:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:49:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:49:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:49:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:49:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:50:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:50:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:50:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:50:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:50:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:50:06 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:50:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:50:08 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:50:08 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=25.055950164794922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 63270d07-97b5-4d60-87a4-5f467b1848ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 2e206998-f8e0-4fdf-8691-63dd3fd1d175 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:50:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'flavor' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:09 user nova-compute[74892]: INFO nova.compute.manager [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Attaching volume ee75c3bb-5bb5-417d-9063-b160a3f82907 to /dev/vdb
Nov 15 14:50:09 user nova-compute[74892]: DEBUG os_brick.utils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:50:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba76691-c09a-4f5f-ab98-088276d55b60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa3f4ee-ea29-489c-a6a1-b1e6a8f93b8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1cfccf-cf07-4257-8100-dca462ed1560]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a7720-b998-4c3d-a0aa-91c5981df313]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:50:10 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e29c56-647d-4f78-ac7c-f661a2e98c73]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG os_brick.utils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating existing volume attachment record: 9e568d00-d4e6-48f7-ab2e-e451915e87f7 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THakhgzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:50:15 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:50:15 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:50:15 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[feeb543b-37cb-4030-b953-9334a4df290c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:50:15 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2875d17e-bee2-4a7d-a4b3-1e48d04d5b22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907] added
Nov 15 14:50:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a0fc5c-3afa-495f-a989-65c643aa9b9a]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4afe1df-b4a5-4954-8050-ef0024062c9c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THakhgzC {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THakhgzC" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[470ea6c4-e3d7-446f-a91b-91d953d1dffe]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THakhgzC'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6afb7f-cc36-4e2b-abff-cb21a76b5c3e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c048465-37d4-4387-8736-ed95672d0545]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:50:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:50:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00ccdc1-9291-42dc-bd26-d6973ad72f84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260]
Nov 15 14:50:15 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260] successful.
Nov 15 14:50:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c7fa0-8116-4eec-8b93-ae2c3f584bf9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf92e53-60a7-47a9-ab2b-910fcfbb107e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:50:15 user nova-compute[74892]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:50:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:50:15 user nova-compute[74892]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:50:15 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a58fdcd-0d07-47d7-a7f0-3e55e9c854af]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:50:15 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THakhgzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:50:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:50:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23764613832316632', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:50:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764613832316632', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:50:16 user nova-compute[74892]: DEBUG nova.objects.instance [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'flavor' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:50:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:50:16 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:50:16 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:50:16 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:50:16 user nova-compute[74892]:   <serial>ee75c3bb-5bb5-417d-9063-b160a3f82907</serial>
Nov 15 14:50:16 user nova-compute[74892]: </disk>
Nov 15 14:50:16 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:50:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:50:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:50:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No VIF found with MAC fa:16:3e:16:7a:42, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:50:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2adb6d0e-b1dc-4bfc-a13e-d99d61e1723c tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.383s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e7f2ca09-f451-413e-b4f5-90aab20c39ce req-2e1fc072-0c48-4396-87ff-97d10e87c86e service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-e7f2ca09-f451-413e-b4f5-90aab20c39ce req-2e1fc072-0c48-4396-87ff-97d10e87c86e service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing instance network info cache due to event network-changed-8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e7f2ca09-f451-413e-b4f5-90aab20c39ce req-2e1fc072-0c48-4396-87ff-97d10e87c86e service nova] Acquiring lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e7f2ca09-f451-413e-b4f5-90aab20c39ce req-2e1fc072-0c48-4396-87ff-97d10e87c86e service nova] Acquired lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-e7f2ca09-f451-413e-b4f5-90aab20c39ce req-2e1fc072-0c48-4396-87ff-97d10e87c86e service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Refreshing network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:18 user nova-compute[74892]: INFO nova.compute.manager [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Terminating instance
Nov 15 14:50:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-e7f2ca09-f451-413e-b4f5-90aab20c39ce req-2e1fc072-0c48-4396-87ff-97d10e87c86e service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updated VIF entry in instance network info cache for port 8b9592fd-597e-4615-aead-2f2da27a1780. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-e7f2ca09-f451-413e-b4f5-90aab20c39ce req-2e1fc072-0c48-4396-87ff-97d10e87c86e service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [{"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:50:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e7f2ca09-f451-413e-b4f5-90aab20c39ce req-2e1fc072-0c48-4396-87ff-97d10e87c86e service nova] Releasing lock "refresh_cache-2e206998-f8e0-4fdf-8691-63dd3fd1d175" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:50:19 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Instance destroyed successfully.
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lazy-loading 'resources' on Instance uuid 2e206998-f8e0-4fdf-8691-63dd3fd1d175 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T14:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2113330819',display_name='tempest-TestShelveInstance-server-2113330819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2113330819',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn1dGPaMJppoa7EXGzsStHTAfyndyKAglUq0QxuW1P1XJ4cjOq0PdcujBDU3xgzp9LuSoyF5KMmnACsBGklfPTafAvR6s+TWsXWV6dRc45cH76Si1RC7LFIqeIAcA4XnA==',key_name='tempest-TestShelveInstance-1733307534',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:48:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d7d65ebc02a4198b310bdd6b9f28d58',ramdisk_id='',reservation_id='r-6avx5ypp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1148492158',owner_user_name='tempest-TestShelveInstance-1148492158-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:48:39Z,user_data=None,user_id='d1ca0e8ded8246cb975373043fcf350c',uuid=2e206998-f8e0-4fdf-8691-63dd3fd1d175,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converting VIF {"id": "8b9592fd-597e-4615-aead-2f2da27a1780", "address": "fa:16:3e:53:ca:8b", "network": {"id": "309529a9-5cb0-4d1a-9104-405bd5b358f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1756842348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7d65ebc02a4198b310bdd6b9f28d58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b9592fd-59", "ovs_interfaceid": "8b9592fd-597e-4615-aead-2f2da27a1780", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_vif [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b9592fd-59, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9db8aa1-c7d6-4a66-bac4-4c38a9bd4359) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:19 user nova-compute[74892]: INFO os_vif [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ca:8b,bridge_name='br-int',has_traffic_filtering=True,id=8b9592fd-597e-4615-aead-2f2da27a1780,network=Network(309529a9-5cb0-4d1a-9104-405bd5b358f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b9592fd-59')
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yCelYbxT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:50:19 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba1803-ddd9-483c-92ed-448ac864331c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:50:19 user nova-compute[74892]: No targets found.
Nov 15 14:50:19 user nova-compute[74892]: iSNS:
Nov 15 14:50:19 user nova-compute[74892]: No targets found.
Nov 15 14:50:19 user nova-compute[74892]: STATIC:
Nov 15 14:50:19 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907
Nov 15 14:50:19 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:50:19 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:50:19 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98
Nov 15 14:50:19 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:50:19 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:50:19 user nova-compute[74892]: FIRMWARE:
Nov 15 14:50:19 user nova-compute[74892]: No targets found.
Nov 15 14:50:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:50:19 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:50:19 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563cb7b-eca0-4609-b11c-21860fd846f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ad90b-f8db-47c4-a66f-898f264998a8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:50:19 user nova-compute[74892]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:50:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 (non-flash)
Nov 15 14:50:19 user nova-compute[74892]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:50:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00600040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[819e2dae-1269-4023-81f0-b1f76fee990b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0695a0e-f847-4e1b-9c61-88c5a6b4544c]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85ac4c2-9e2b-47c4-8d63-f4ae55d5a586]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1573021-60b7-49e6-8449-d36bc6364746]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO852d723b-03ee4aa99f370b52', '/dev/disk/by-id/scsi-23033656534616139', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_852d723b') {{(pid=85038) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4122a97d-6ca4-44a7-aa30-029f20b28583]: (4, None) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c772ec-6bac-4b35-9453-c0a6e02608ba]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[777314cc-2339-4cd9-ac12-4231e6f08b37]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260]
Nov 15 14:50:19 user nova-compute[74892]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98, portal: 172.16.0.220,3260] successful.
Nov 15 14:50:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b51ed4d-47a9-48c9-8311-82e6c3118c98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[154ddcfd-d300-4d91-a1c5-a57ae9642fdb]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] <== disconnect_volume: return (291ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:50:19 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Deleting instance files /opt/stack/data/nova/instances/2e206998-f8e0-4fdf-8691-63dd3fd1d175_del
Nov 15 14:50:19 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Deletion of /opt/stack/data/nova/instances/2e206998-f8e0-4fdf-8691-63dd3fd1d175_del complete
Nov 15 14:50:19 user nova-compute[74892]: INFO nova.compute.manager [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 15 14:50:19 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:50:19 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Took 0.41 seconds to deallocate network for instance.
Nov 15 14:50:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-c8dc2a29-c6c7-4466-8477-eb11426d9aa9 req-bf35ec22-7212-425a-bbc2-b284a4b1546d service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-deleted-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-unplugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] No waiting events found dispatching network-vif-unplugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-unplugged-8b9592fd-597e-4615-aead-2f2da27a1780 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] Acquiring lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG nova.compute.manager [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] No waiting events found dispatching network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:50:20 user nova-compute[74892]: WARNING nova.compute.manager [req-97aaba9c-f635-47b4-826c-213f4fcc753b req-0fbc45af-d837-4ef7-b96a-9b1c3540a4e2 service nova] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Received unexpected event network-vif-plugged-8b9592fd-597e-4615-aead-2f2da27a1780 for instance with vm_state active and task_state deleting.
Nov 15 14:50:20 user nova-compute[74892]: INFO nova.compute.manager [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 14:50:20 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] [instance: 2e206998-f8e0-4fdf-8691-63dd3fd1d175] Deleting volume: 5b51ed4d-47a9-48c9-8311-82e6c3118c98 {{(pid=74892) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:50:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:20 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Deleted allocations for instance 2e206998-f8e0-4fdf-8691-63dd3fd1d175
Nov 15 14:50:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff8c6308-7114-403a-b60c-1f0bfdec034e tempest-TestShelveInstance-1148492158 tempest-TestShelveInstance-1148492158-project-member] Lock "2e206998-f8e0-4fdf-8691-63dd3fd1d175" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.697s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-7e6c353a-3559-4c1d-ba2e-dc54b266a341 req-b7800897-85e8-4b37-ba9e-e58f70c47096 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-7e6c353a-3559-4c1d-ba2e-dc54b266a341 req-b7800897-85e8-4b37-ba9e-e58f70c47096 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing instance network info cache due to event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:50:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7e6c353a-3559-4c1d-ba2e-dc54b266a341 req-b7800897-85e8-4b37-ba9e-e58f70c47096 service nova] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:50:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7e6c353a-3559-4c1d-ba2e-dc54b266a341 req-b7800897-85e8-4b37-ba9e-e58f70c47096 service nova] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:50:22 user nova-compute[74892]: DEBUG nova.network.neutron [req-7e6c353a-3559-4c1d-ba2e-dc54b266a341 req-b7800897-85e8-4b37-ba9e-e58f70c47096 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:50:23 user nova-compute[74892]: DEBUG nova.network.neutron [req-7e6c353a-3559-4c1d-ba2e-dc54b266a341 req-b7800897-85e8-4b37-ba9e-e58f70c47096 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updated VIF entry in instance network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:50:23 user nova-compute[74892]: DEBUG nova.network.neutron [req-7e6c353a-3559-4c1d-ba2e-dc54b266a341 req-b7800897-85e8-4b37-ba9e-e58f70c47096 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:50:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7e6c353a-3559-4c1d-ba2e-dc54b266a341 req-b7800897-85e8-4b37-ba9e-e58f70c47096 service nova] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:50:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-4005395b-3fec-4dc4-9d3b-53ef74e47a87 req-dd318438-b625-4e3c-b072-fd4326752c3a service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:23 user nova-compute[74892]: DEBUG nova.compute.manager [req-4005395b-3fec-4dc4-9d3b-53ef74e47a87 req-dd318438-b625-4e3c-b072-fd4326752c3a service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing instance network info cache due to event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:50:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4005395b-3fec-4dc4-9d3b-53ef74e47a87 req-dd318438-b625-4e3c-b072-fd4326752c3a service nova] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:50:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4005395b-3fec-4dc4-9d3b-53ef74e47a87 req-dd318438-b625-4e3c-b072-fd4326752c3a service nova] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:50:23 user nova-compute[74892]: DEBUG nova.network.neutron [req-4005395b-3fec-4dc4-9d3b-53ef74e47a87 req-dd318438-b625-4e3c-b072-fd4326752c3a service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:50:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-4005395b-3fec-4dc4-9d3b-53ef74e47a87 req-dd318438-b625-4e3c-b072-fd4326752c3a service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updated VIF entry in instance network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:50:24 user nova-compute[74892]: DEBUG nova.network.neutron [req-4005395b-3fec-4dc4-9d3b-53ef74e47a87 req-dd318438-b625-4e3c-b072-fd4326752c3a service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:50:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-4005395b-3fec-4dc4-9d3b-53ef74e47a87 req-dd318438-b625-4e3c-b072-fd4326752c3a service nova] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:50:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:26 user nova-compute[74892]: INFO nova.compute.manager [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Rebooting instance
Nov 15 14:50:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:50:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:50:26 user nova-compute[74892]: DEBUG nova.network.neutron [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG nova.network.neutron [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-b560541a-70ac-4873-aa63-4f5d2c5d7a2e req-fbd8a355-34e2-4fcf-8eab-962ec7b5f8bc service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-unplugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b560541a-70ac-4873-aa63-4f5d2c5d7a2e req-fbd8a355-34e2-4fcf-8eab-962ec7b5f8bc service nova] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b560541a-70ac-4873-aa63-4f5d2c5d7a2e req-fbd8a355-34e2-4fcf-8eab-962ec7b5f8bc service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b560541a-70ac-4873-aa63-4f5d2c5d7a2e req-fbd8a355-34e2-4fcf-8eab-962ec7b5f8bc service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:27 user nova-compute[74892]: DEBUG nova.compute.manager [req-b560541a-70ac-4873-aa63-4f5d2c5d7a2e req-fbd8a355-34e2-4fcf-8eab-962ec7b5f8bc service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] No waiting events found dispatching network-vif-unplugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:50:27 user nova-compute[74892]: WARNING nova.compute.manager [req-b560541a-70ac-4873-aa63-4f5d2c5d7a2e req-fbd8a355-34e2-4fcf-8eab-962ec7b5f8bc service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received unexpected event network-vif-unplugged-54fccf43-8fcf-4679-9a9d-d4d118b17def for instance with vm_state active and task_state reboot_started_hard.
Nov 15 14:50:28 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Instance destroyed successfully.
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.objects.instance [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'resources' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-398515450',display_name='tempest-TestMinimumBasicScenario-server-398515450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-398515450',id=49,image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKXBSEUcUUjM+c/6DXEyeDoRu9sW++oIrxWLt2Glm3/CgxEC0XfGeZLW4jlg6pjb83+3q4ykt17mjRPCCBPAqZ6IWiqkA25Q6PCiojESRTF80uMzOFTtxd1rGqVxQ2Ntg==',key_name='tempest-TestMinimumBasicScenario-465543366',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:48:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-rfrp3aye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:50:27Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=63270d07-97b5-4d60-87a4-5f467b1848ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_vif [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54fccf43-8f, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecf6f920-1227-4be0-9cfa-7a7119f2ca68) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:28 user nova-compute[74892]: INFO os_vif [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f')
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THakhgzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:50:28 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08508a2-d736-4758-8731-1f81b73bd97b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:50:28 user nova-compute[74892]: No targets found.
Nov 15 14:50:28 user nova-compute[74892]: iSNS:
Nov 15 14:50:28 user nova-compute[74892]: No targets found.
Nov 15 14:50:28 user nova-compute[74892]: STATIC:
Nov 15 14:50:28 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907
Nov 15 14:50:28 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:50:28 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:50:28 user nova-compute[74892]: FIRMWARE:
Nov 15 14:50:28 user nova-compute[74892]: No targets found.
Nov 15 14:50:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:50:28 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:50:28 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[91351867-a89b-4e10-b336-e249bf127993]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa03dcc6-33dd-4bcb-99db-71005baf42f7]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:50:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:50:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd00415e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7c95f9-ff82-4e69-899d-6191958580d1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa40a8a-4efe-4504-8d46-75ac8803254b]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e38e910-ba3b-48b6-9efc-dabef648f502]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d355edf-bcbd-4a2c-90bc-b27e86d0a1aa]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca123179-e279-4951-9584-9b23287df223]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0740de10-79a6-4a9a-b059-09352f9e924d]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260]
Nov 15 14:50:28 user nova-compute[74892]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260] successful.
Nov 15 14:50:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1df026-9f59-4ab4-a2ba-b03a98ef5903]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] <== disconnect_volume: return (284ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Start _get_guest_xml network_info=[{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7f67e253-f924-47bd-bbf2-9dcd0c0ce012,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '7f67e253-f924-47bd-bbf2-9dcd0c0ce012'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THakhgzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '63270d07-97b5-4d60-87a4-5f467b1848ce', 'attached_at': '', 'detached_at': '', 'volume_id': 'ee75c3bb-5bb5-417d-9063-b160a3f82907', 'serial': 'ee75c3bb-5bb5-417d-9063-b160a3f82907'}, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '9e568d00-d4e6-48f7-ab2e-e451915e87f7', 'delete_on_termination': False, 'volume_type': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:50:28 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:50:28 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7f67e253-f924-47bd-bbf2-9dcd0c0ce012,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.objects.instance [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.objects.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Object Instance<63270d07-97b5-4d60-87a4-5f467b1848ce> lazy-loaded attributes: resources,vcpu_model {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THakhgzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:50:28 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:50:28 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:50:28 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2d9d98-97f7-4ff2-8eed-bf553bb5f940]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:50:28 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8650fd6b-2629-4008-9194-027aad98918c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907] added
Nov 15 14:50:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a2d99e-3af9-4914-9725-cdb40f386400]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[980e6ddf-b2cb-4918-8ceb-92920cea2af6]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THakhgzC {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THakhgzC" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e566a6bb-f3a6-42af-9fef-7738694d0fde]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THakhgzC'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfdae7e-2d24-4d42-9f9b-b9cf8cbb442c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d4e02d-a1e6-417e-b4c1-bf5236cda9df]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:50:28 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:50:28 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:50:28 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 14:50:28 user nova-compute[74892]: 
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc00d6d2-7ff8-4f65-a27c-c896abf04482]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260]
Nov 15 14:50:28 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260] successful.
Nov 15 14:50:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[603c8110-4f14-4eea-a47b-bd4fc76c6826]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fee5c9-c528-46ae-9499-374ed6b47356]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:50:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:50:28 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f10304-9c38-4b75-8e44-135d54ad8e32]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:50:28 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THakhgzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-a4672dce-bef3-49d7-9739-3daca4a3e3a3 req-71a95479-9bb4-4e6b-91b7-ddef6c7b0b12 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a4672dce-bef3-49d7-9739-3daca4a3e3a3 req-71a95479-9bb4-4e6b-91b7-ddef6c7b0b12 service nova] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a4672dce-bef3-49d7-9739-3daca4a3e3a3 req-71a95479-9bb4-4e6b-91b7-ddef6c7b0b12 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a4672dce-bef3-49d7-9739-3daca4a3e3a3 req-71a95479-9bb4-4e6b-91b7-ddef6c7b0b12 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.compute.manager [req-a4672dce-bef3-49d7-9739-3daca4a3e3a3 req-71a95479-9bb4-4e6b-91b7-ddef6c7b0b12 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] No waiting events found dispatching network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:50:29 user nova-compute[74892]: WARNING nova.compute.manager [req-a4672dce-bef3-49d7-9739-3daca4a3e3a3 req-71a95479-9bb4-4e6b-91b7-ddef6c7b0b12 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received unexpected event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def for instance with vm_state active and task_state reboot_started_hard.
Nov 15 14:50:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23764613832316632', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764613832316632', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-398515450',display_name='tempest-TestMinimumBasicScenario-server-398515450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-398515450',id=49,image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKXBSEUcUUjM+c/6DXEyeDoRu9sW++oIrxWLt2Glm3/CgxEC0XfGeZLW4jlg6pjb83+3q4ykt17mjRPCCBPAqZ6IWiqkA25Q6PCiojESRTF80uMzOFTtxd1rGqVxQ2Ntg==',key_name='tempest-TestMinimumBasicScenario-465543366',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:48:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-rfrp3aye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:50:27Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=63270d07-97b5-4d60-87a4-5f467b1848ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.objects.instance [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'pci_devices' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.objects.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Object Instance<63270d07-97b5-4d60-87a4-5f467b1848ce> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:50:29 user nova-compute[74892]:   <uuid>63270d07-97b5-4d60-87a4-5f467b1848ce</uuid>
Nov 15 14:50:29 user nova-compute[74892]:   <name>instance-00000031</name>
Nov 15 14:50:29 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:50:29 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:50:29 user nova-compute[74892]:   <metadata>
Nov 15 14:50:29 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:50:29 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:50:29 user nova-compute[74892]:       <nova:name>tempest-TestMinimumBasicScenario-server-398515450</nova:name>
Nov 15 14:50:29 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:50:28</nova:creationTime>
Nov 15 14:50:29 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:50:29 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:50:29 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:50:29 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:50:29 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:50:29 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:50:29 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:50:29 user nova-compute[74892]:       <nova:owner>
Nov 15 14:50:29 user nova-compute[74892]:         <nova:user uuid="bd87bf1610b740e98fbb88b245301c56">tempest-TestMinimumBasicScenario-363938991-project-member</nova:user>
Nov 15 14:50:29 user nova-compute[74892]:         <nova:project uuid="e82b93eb8ffe4a2f9ac702406fb1df88">tempest-TestMinimumBasicScenario-363938991</nova:project>
Nov 15 14:50:29 user nova-compute[74892]:       </nova:owner>
Nov 15 14:50:29 user nova-compute[74892]:       <nova:root type="image" uuid="7f67e253-f924-47bd-bbf2-9dcd0c0ce012"/>
Nov 15 14:50:29 user nova-compute[74892]:       <nova:ports>
Nov 15 14:50:29 user nova-compute[74892]:         <nova:port uuid="54fccf43-8fcf-4679-9a9d-d4d118b17def">
Nov 15 14:50:29 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 14:50:29 user nova-compute[74892]:         </nova:port>
Nov 15 14:50:29 user nova-compute[74892]:       </nova:ports>
Nov 15 14:50:29 user nova-compute[74892]:     </nova:instance>
Nov 15 14:50:29 user nova-compute[74892]:   </metadata>
Nov 15 14:50:29 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:50:29 user nova-compute[74892]:     <system>
Nov 15 14:50:29 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:50:29 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:50:29 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:50:29 user nova-compute[74892]:       <entry name="serial">63270d07-97b5-4d60-87a4-5f467b1848ce</entry>
Nov 15 14:50:29 user nova-compute[74892]:       <entry name="uuid">63270d07-97b5-4d60-87a4-5f467b1848ce</entry>
Nov 15 14:50:29 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:50:29 user nova-compute[74892]:     </system>
Nov 15 14:50:29 user nova-compute[74892]:   </sysinfo>
Nov 15 14:50:29 user nova-compute[74892]:   <os>
Nov 15 14:50:29 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:50:29 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:50:29 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:50:29 user nova-compute[74892]:   </os>
Nov 15 14:50:29 user nova-compute[74892]:   <features>
Nov 15 14:50:29 user nova-compute[74892]:     <acpi/>
Nov 15 14:50:29 user nova-compute[74892]:     <apic/>
Nov 15 14:50:29 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:50:29 user nova-compute[74892]:   </features>
Nov 15 14:50:29 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:50:29 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:50:29 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:50:29 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:50:29 user nova-compute[74892]:   </clock>
Nov 15 14:50:29 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:50:29 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:50:29 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:50:29 user nova-compute[74892]:   </cpu>
Nov 15 14:50:29 user nova-compute[74892]:   <devices>
Nov 15 14:50:29 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:50:29 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:50:29 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk"/>
Nov 15 14:50:29 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:50:29 user nova-compute[74892]:     </disk>
Nov 15 14:50:29 user nova-compute[74892]:     <disk type="block" device="disk">
Nov 15 14:50:29 user nova-compute[74892]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:50:29 user nova-compute[74892]:       <source dev="/dev/sdb"/>
Nov 15 14:50:29 user nova-compute[74892]:       <target dev="vdb" bus="virtio"/>
Nov 15 14:50:29 user nova-compute[74892]:       <serial>ee75c3bb-5bb5-417d-9063-b160a3f82907</serial>
Nov 15 14:50:29 user nova-compute[74892]:     </disk>
Nov 15 14:50:29 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:50:29 user nova-compute[74892]:       <mac address="fa:16:3e:16:7a:42"/>
Nov 15 14:50:29 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:50:29 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:50:29 user nova-compute[74892]:       <target dev="tap54fccf43-8f"/>
Nov 15 14:50:29 user nova-compute[74892]:     </interface>
Nov 15 14:50:29 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:50:29 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/console.log" append="off"/>
Nov 15 14:50:29 user nova-compute[74892]:     </serial>
Nov 15 14:50:29 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:50:29 user nova-compute[74892]:     <video>
Nov 15 14:50:29 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:50:29 user nova-compute[74892]:     </video>
Nov 15 14:50:29 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:50:29 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:50:29 user nova-compute[74892]:     </rng>
Nov 15 14:50:29 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:50:29 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:50:29 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:50:29 user nova-compute[74892]:     </memballoon>
Nov 15 14:50:29 user nova-compute[74892]:   </devices>
Nov 15 14:50:29 user nova-compute[74892]: </domain>
Nov 15 14:50:29 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:50:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.objects.instance [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.objects.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Object Instance<63270d07-97b5-4d60-87a4-5f467b1848ce> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Cannot resize image /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.objects.instance [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'migration_context' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.objects.base [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Object Instance<63270d07-97b5-4d60-87a4-5f467b1848ce> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74892) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-398515450',display_name='tempest-TestMinimumBasicScenario-server-398515450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-398515450',id=49,image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKXBSEUcUUjM+c/6DXEyeDoRu9sW++oIrxWLt2Glm3/CgxEC0XfGeZLW4jlg6pjb83+3q4ykt17mjRPCCBPAqZ6IWiqkA25Q6PCiojESRTF80uMzOFTtxd1rGqVxQ2Ntg==',key_name='tempest-TestMinimumBasicScenario-465543366',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:48:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-rfrp3aye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:50:27Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=63270d07-97b5-4d60-87a4-5f467b1848ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG os_vif [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7f5107e-1a15-59f8-8658-345fac2ef15b', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54fccf43-8f, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54fccf43-8f, col_values=(('qos', UUID('1e5fe788-dec7-4886-a3fc-a1481388fcc6')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54fccf43-8f, col_values=(('external_ids', {'iface-id': '54fccf43-8fcf-4679-9a9d-d4d118b17def', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:7a:42', 'vm-uuid': '63270d07-97b5-4d60-87a4-5f467b1848ce'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:30 user nova-compute[74892]: INFO os_vif [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f')
Nov 15 14:50:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-a3ca6778-f194-408f-a980-1340f8833025 req-6a029348-1f23-45c6-b299-fe5966129815 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a3ca6778-f194-408f-a980-1340f8833025 req-6a029348-1f23-45c6-b299-fe5966129815 service nova] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a3ca6778-f194-408f-a980-1340f8833025 req-6a029348-1f23-45c6-b299-fe5966129815 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a3ca6778-f194-408f-a980-1340f8833025 req-6a029348-1f23-45c6-b299-fe5966129815 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:32 user nova-compute[74892]: DEBUG nova.compute.manager [req-a3ca6778-f194-408f-a980-1340f8833025 req-6a029348-1f23-45c6-b299-fe5966129815 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] No waiting events found dispatching network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:50:32 user nova-compute[74892]: WARNING nova.compute.manager [req-a3ca6778-f194-408f-a980-1340f8833025 req-6a029348-1f23-45c6-b299-fe5966129815 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received unexpected event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def for instance with vm_state active and task_state reboot_started_hard.
Nov 15 14:50:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:50:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Instance rebooted successfully.
Nov 15 14:50:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:50:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-85fc3776-307d-4e45-a395-051c9eb12859 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.292s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-645ff6df-4056-404f-b7ac-665a17b2afec req-7b9d9f88-f276-4da0-b114-491229a040f9 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:50:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-645ff6df-4056-404f-b7ac-665a17b2afec req-7b9d9f88-f276-4da0-b114-491229a040f9 service nova] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:50:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-645ff6df-4056-404f-b7ac-665a17b2afec req-7b9d9f88-f276-4da0-b114-491229a040f9 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:50:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-645ff6df-4056-404f-b7ac-665a17b2afec req-7b9d9f88-f276-4da0-b114-491229a040f9 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:50:34 user nova-compute[74892]: DEBUG nova.compute.manager [req-645ff6df-4056-404f-b7ac-665a17b2afec req-7b9d9f88-f276-4da0-b114-491229a040f9 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] No waiting events found dispatching network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:50:34 user nova-compute[74892]: WARNING nova.compute.manager [req-645ff6df-4056-404f-b7ac-665a17b2afec req-7b9d9f88-f276-4da0-b114-491229a040f9 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received unexpected event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def for instance with vm_state active and task_state None.
Nov 15 14:50:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:50:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:50:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:50:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:50:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:50:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:06 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:51:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:51:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:51:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:51:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:51:07 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:51:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:51:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:51:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:51:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:08 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:51:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:51:09 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:51:09 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:51:09 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8935MB free_disk=25.04568862915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 63270d07-97b5-4d60-87a4-5f467b1848ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:51:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:51:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:20 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:51:31 user nova-compute[74892]: INFO nova.compute.claims [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Claim successful on node user
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.213s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.network.neutron [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:51:31 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:51:31 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Creating image(s)
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "/opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "/opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG nova.policy [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e10a3f0b4f784132a7b721651117c7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d5cbe17d4c49329687b3b42e8e1d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:51:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk 1073741824" returned: 0 in 0.049s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG nova.network.neutron [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Successfully created port: 834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Cannot resize image /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Ensure instance console log exists: /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Successfully updated port: 834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquired lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-5fe8bbca-b7a1-4705-bce9-763ccb556cc6 req-9f8df19a-723e-4525-8472-179389f331e5 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-changed-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.compute.manager [req-5fe8bbca-b7a1-4705-bce9-763ccb556cc6 req-9f8df19a-723e-4525-8472-179389f331e5 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Refreshing instance network info cache due to event network-changed-834d556d-6325-4227-9ceb-9206cc18ae86. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5fe8bbca-b7a1-4705-bce9-763ccb556cc6 req-9f8df19a-723e-4525-8472-179389f331e5 service nova] Acquiring lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.network.neutron [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Releasing lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Instance network_info: |[{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5fe8bbca-b7a1-4705-bce9-763ccb556cc6 req-9f8df19a-723e-4525-8472-179389f331e5 service nova] Acquired lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.network.neutron [req-5fe8bbca-b7a1-4705-bce9-763ccb556cc6 req-9f8df19a-723e-4525-8472-179389f331e5 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Refreshing network info cache for port 834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Start _get_guest_xml network_info=[{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:51:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:51:33 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:51:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1338469808',display_name='tempest-TestStampPattern-server-1338469808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1338469808',id=50,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPeJ0IXGEcJc61O3mU1/dq8f65qXLLR6+kEyh+NghLrhciWvaUXjA1cbWnVhtXJ0Ufufr1m2LL7P+vg+oA9LDz7J65DDQ6e7gmbZegj/iYeF3EM5sjDlLEJGrRKf+31A==',key_name='tempest-TestStampPattern-983974885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39d5cbe17d4c49329687b3b42e8e1d74',ramdisk_id='',reservation_id='r-tg67n33k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-665647939',owner_user_name='tempest-TestStampPattern-665647939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:51:32Z,user_data=None,user_id='e10a3f0b4f784132a7b721651117c7b2',uuid=3b6bb6ef-4936-4598-b95c-cc5f501c2737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converting VIF {"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:42:c1,bridge_name='br-int',has_traffic_filtering=True,id=834d556d-6325-4227-9ceb-9206cc18ae86,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834d556d-63') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.objects.instance [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:51:34 user nova-compute[74892]:   <uuid>3b6bb6ef-4936-4598-b95c-cc5f501c2737</uuid>
Nov 15 14:51:34 user nova-compute[74892]:   <name>instance-00000032</name>
Nov 15 14:51:34 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:51:34 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:51:34 user nova-compute[74892]:   <metadata>
Nov 15 14:51:34 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:51:34 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:51:34 user nova-compute[74892]:       <nova:name>tempest-TestStampPattern-server-1338469808</nova:name>
Nov 15 14:51:34 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:51:33</nova:creationTime>
Nov 15 14:51:34 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:51:34 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:51:34 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:51:34 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:51:34 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:51:34 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:51:34 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:51:34 user nova-compute[74892]:       <nova:owner>
Nov 15 14:51:34 user nova-compute[74892]:         <nova:user uuid="e10a3f0b4f784132a7b721651117c7b2">tempest-TestStampPattern-665647939-project-member</nova:user>
Nov 15 14:51:34 user nova-compute[74892]:         <nova:project uuid="39d5cbe17d4c49329687b3b42e8e1d74">tempest-TestStampPattern-665647939</nova:project>
Nov 15 14:51:34 user nova-compute[74892]:       </nova:owner>
Nov 15 14:51:34 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 14:51:34 user nova-compute[74892]:       <nova:ports>
Nov 15 14:51:34 user nova-compute[74892]:         <nova:port uuid="834d556d-6325-4227-9ceb-9206cc18ae86">
Nov 15 14:51:34 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 14:51:34 user nova-compute[74892]:         </nova:port>
Nov 15 14:51:34 user nova-compute[74892]:       </nova:ports>
Nov 15 14:51:34 user nova-compute[74892]:     </nova:instance>
Nov 15 14:51:34 user nova-compute[74892]:   </metadata>
Nov 15 14:51:34 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:51:34 user nova-compute[74892]:     <system>
Nov 15 14:51:34 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:51:34 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:51:34 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:51:34 user nova-compute[74892]:       <entry name="serial">3b6bb6ef-4936-4598-b95c-cc5f501c2737</entry>
Nov 15 14:51:34 user nova-compute[74892]:       <entry name="uuid">3b6bb6ef-4936-4598-b95c-cc5f501c2737</entry>
Nov 15 14:51:34 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:51:34 user nova-compute[74892]:     </system>
Nov 15 14:51:34 user nova-compute[74892]:   </sysinfo>
Nov 15 14:51:34 user nova-compute[74892]:   <os>
Nov 15 14:51:34 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:51:34 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:51:34 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:51:34 user nova-compute[74892]:   </os>
Nov 15 14:51:34 user nova-compute[74892]:   <features>
Nov 15 14:51:34 user nova-compute[74892]:     <acpi/>
Nov 15 14:51:34 user nova-compute[74892]:     <apic/>
Nov 15 14:51:34 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:51:34 user nova-compute[74892]:   </features>
Nov 15 14:51:34 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:51:34 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:51:34 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:51:34 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:51:34 user nova-compute[74892]:   </clock>
Nov 15 14:51:34 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:51:34 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:51:34 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:51:34 user nova-compute[74892]:   </cpu>
Nov 15 14:51:34 user nova-compute[74892]:   <devices>
Nov 15 14:51:34 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:51:34 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:51:34 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk"/>
Nov 15 14:51:34 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:51:34 user nova-compute[74892]:     </disk>
Nov 15 14:51:34 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:51:34 user nova-compute[74892]:       <mac address="fa:16:3e:df:42:c1"/>
Nov 15 14:51:34 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:51:34 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:51:34 user nova-compute[74892]:       <target dev="tap834d556d-63"/>
Nov 15 14:51:34 user nova-compute[74892]:     </interface>
Nov 15 14:51:34 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:51:34 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/console.log" append="off"/>
Nov 15 14:51:34 user nova-compute[74892]:     </serial>
Nov 15 14:51:34 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:51:34 user nova-compute[74892]:     <video>
Nov 15 14:51:34 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:51:34 user nova-compute[74892]:     </video>
Nov 15 14:51:34 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:51:34 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:51:34 user nova-compute[74892]:     </rng>
Nov 15 14:51:34 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:51:34 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:51:34 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:51:34 user nova-compute[74892]:     </memballoon>
Nov 15 14:51:34 user nova-compute[74892]:   </devices>
Nov 15 14:51:34 user nova-compute[74892]: </domain>
Nov 15 14:51:34 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1338469808',display_name='tempest-TestStampPattern-server-1338469808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1338469808',id=50,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPeJ0IXGEcJc61O3mU1/dq8f65qXLLR6+kEyh+NghLrhciWvaUXjA1cbWnVhtXJ0Ufufr1m2LL7P+vg+oA9LDz7J65DDQ6e7gmbZegj/iYeF3EM5sjDlLEJGrRKf+31A==',key_name='tempest-TestStampPattern-983974885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39d5cbe17d4c49329687b3b42e8e1d74',ramdisk_id='',reservation_id='r-tg67n33k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-665647939',owner_user_name='tempest-TestStampPattern-665647939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:51:32Z,user_data=None,user_id='e10a3f0b4f784132a7b721651117c7b2',uuid=3b6bb6ef-4936-4598-b95c-cc5f501c2737,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converting VIF {"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:42:c1,bridge_name='br-int',has_traffic_filtering=True,id=834d556d-6325-4227-9ceb-9206cc18ae86,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834d556d-63') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG os_vif [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:42:c1,bridge_name='br-int',has_traffic_filtering=True,id=834d556d-6325-4227-9ceb-9206cc18ae86,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834d556d-63') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aab105d2-c92e-5f2a-be3a-e7b025cd8ffe', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap834d556d-63, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap834d556d-63, col_values=(('qos', UUID('b6b59db1-bbc5-494a-9ea4-59c10db34c46')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap834d556d-63, col_values=(('external_ids', {'iface-id': '834d556d-6325-4227-9ceb-9206cc18ae86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:42:c1', 'vm-uuid': '3b6bb6ef-4936-4598-b95c-cc5f501c2737'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:34 user nova-compute[74892]: INFO os_vif [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:42:c1,bridge_name='br-int',has_traffic_filtering=True,id=834d556d-6325-4227-9ceb-9206cc18ae86,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834d556d-63')
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No VIF found with MAC fa:16:3e:df:42:c1, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-5fe8bbca-b7a1-4705-bce9-763ccb556cc6 req-9f8df19a-723e-4525-8472-179389f331e5 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updated VIF entry in instance network info cache for port 834d556d-6325-4227-9ceb-9206cc18ae86. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG nova.network.neutron [req-5fe8bbca-b7a1-4705-bce9-763ccb556cc6 req-9f8df19a-723e-4525-8472-179389f331e5 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5fe8bbca-b7a1-4705-bce9-763ccb556cc6 req-9f8df19a-723e-4525-8472-179389f331e5 service nova] Releasing lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:51:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-15430d0b-c576-42f7-8124-3fc51ad064f8 req-2c6b8d91-efa7-4879-a7cd-ad34dd01c591 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-15430d0b-c576-42f7-8124-3fc51ad064f8 req-2c6b8d91-efa7-4879-a7cd-ad34dd01c591 service nova] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-15430d0b-c576-42f7-8124-3fc51ad064f8 req-2c6b8d91-efa7-4879-a7cd-ad34dd01c591 service nova] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-15430d0b-c576-42f7-8124-3fc51ad064f8 req-2c6b8d91-efa7-4879-a7cd-ad34dd01c591 service nova] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-15430d0b-c576-42f7-8124-3fc51ad064f8 req-2c6b8d91-efa7-4879-a7cd-ad34dd01c591 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] No waiting events found dispatching network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:51:35 user nova-compute[74892]: WARNING nova.compute.manager [req-15430d0b-c576-42f7-8124-3fc51ad064f8 req-2c6b8d91-efa7-4879-a7cd-ad34dd01c591 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received unexpected event network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 for instance with vm_state building and task_state spawning.
Nov 15 14:51:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:51:37 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Instance spawned successfully.
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:37 user nova-compute[74892]: INFO nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:51:37 user nova-compute[74892]: INFO nova.compute.manager [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Took 6.24 seconds to build instance.
Nov 15 14:51:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-50733c14-430d-4eba-a66c-69a6a27b8a5c tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.356s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-2e3e595c-a3cf-4094-b9da-7e8dc9409408 req-2fa6ba99-f726-4d1b-957e-3f791293a064 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2e3e595c-a3cf-4094-b9da-7e8dc9409408 req-2fa6ba99-f726-4d1b-957e-3f791293a064 service nova] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2e3e595c-a3cf-4094-b9da-7e8dc9409408 req-2fa6ba99-f726-4d1b-957e-3f791293a064 service nova] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2e3e595c-a3cf-4094-b9da-7e8dc9409408 req-2fa6ba99-f726-4d1b-957e-3f791293a064 service nova] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:51:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-2e3e595c-a3cf-4094-b9da-7e8dc9409408 req-2fa6ba99-f726-4d1b-957e-3f791293a064 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] No waiting events found dispatching network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:51:37 user nova-compute[74892]: WARNING nova.compute.manager [req-2e3e595c-a3cf-4094-b9da-7e8dc9409408 req-2fa6ba99-f726-4d1b-957e-3f791293a064 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received unexpected event network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 for instance with vm_state active and task_state None.
Nov 15 14:51:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:51:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:51:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:52:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:52:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:52:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:52:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:52:07 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:52:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:09 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:52:10 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:52:10 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:52:10 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8738MB free_disk=25.014781951904297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 63270d07-97b5-4d60-87a4-5f467b1848ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:52:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:52:12 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:12 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:12 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:12 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:52:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-8650a2ea-b2d9-44f3-beee-7e4fb45a07c6 req-df960be2-b290-47bb-98d0-f40330d7ff04 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:52:18 user nova-compute[74892]: DEBUG nova.compute.manager [req-8650a2ea-b2d9-44f3-beee-7e4fb45a07c6 req-df960be2-b290-47bb-98d0-f40330d7ff04 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing instance network info cache due to event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:52:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8650a2ea-b2d9-44f3-beee-7e4fb45a07c6 req-df960be2-b290-47bb-98d0-f40330d7ff04 service nova] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:52:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8650a2ea-b2d9-44f3-beee-7e4fb45a07c6 req-df960be2-b290-47bb-98d0-f40330d7ff04 service nova] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:52:18 user nova-compute[74892]: DEBUG nova.network.neutron [req-8650a2ea-b2d9-44f3-beee-7e4fb45a07c6 req-df960be2-b290-47bb-98d0-f40330d7ff04 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:52:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-8650a2ea-b2d9-44f3-beee-7e4fb45a07c6 req-df960be2-b290-47bb-98d0-f40330d7ff04 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updated VIF entry in instance network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-8650a2ea-b2d9-44f3-beee-7e4fb45a07c6 req-df960be2-b290-47bb-98d0-f40330d7ff04 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-8650a2ea-b2d9-44f3-beee-7e4fb45a07c6 req-df960be2-b290-47bb-98d0-f40330d7ff04 service nova] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-e7b8b280-03a5-4f03-a4ca-2de95a786e54 req-c88215eb-0d10-48e6-b21f-af96411e0cf0 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.compute.manager [req-e7b8b280-03a5-4f03-a4ca-2de95a786e54 req-c88215eb-0d10-48e6-b21f-af96411e0cf0 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing instance network info cache due to event network-changed-54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e7b8b280-03a5-4f03-a4ca-2de95a786e54 req-c88215eb-0d10-48e6-b21f-af96411e0cf0 service nova] Acquiring lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e7b8b280-03a5-4f03-a4ca-2de95a786e54 req-c88215eb-0d10-48e6-b21f-af96411e0cf0 service nova] Acquired lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-e7b8b280-03a5-4f03-a4ca-2de95a786e54 req-c88215eb-0d10-48e6-b21f-af96411e0cf0 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Refreshing network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:52:19 user nova-compute[74892]: INFO nova.compute.manager [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Detaching volume ee75c3bb-5bb5-417d-9063-b160a3f82907
Nov 15 14:52:19 user nova-compute[74892]: INFO nova.virt.block_device [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Attempting to driver detach volume ee75c3bb-5bb5-417d-9063-b160a3f82907 from mountpoint /dev/vdb
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Attempting to detach device vdb from instance 63270d07-97b5-4d60-87a4-5f467b1848ce from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:52:19 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:52:19 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:52:19 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:52:19 user nova-compute[74892]:   <serial>ee75c3bb-5bb5-417d-9063-b160a3f82907</serial>
Nov 15 14:52:19 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 14:52:19 user nova-compute[74892]: </disk>
Nov 15 14:52:19 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:52:19 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully detached device vdb from instance 63270d07-97b5-4d60-87a4-5f467b1848ce from the persistent domain config.
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63270d07-97b5-4d60-87a4-5f467b1848ce from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:52:19 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:52:19 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:52:19 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:52:19 user nova-compute[74892]:   <serial>ee75c3bb-5bb5-417d-9063-b160a3f82907</serial>
Nov 15 14:52:19 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 14:52:19 user nova-compute[74892]: </disk>
Nov 15 14:52:19 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-e7b8b280-03a5-4f03-a4ca-2de95a786e54 req-c88215eb-0d10-48e6-b21f-af96411e0cf0 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updated VIF entry in instance network info cache for port 54fccf43-8fcf-4679-9a9d-d4d118b17def. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG nova.network.neutron [req-e7b8b280-03a5-4f03-a4ca-2de95a786e54 req-c88215eb-0d10-48e6-b21f-af96411e0cf0 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [{"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:52:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-e7b8b280-03a5-4f03-a4ca-2de95a786e54 req-c88215eb-0d10-48e6-b21f-af96411e0cf0 service nova] Releasing lock "refresh_cache-63270d07-97b5-4d60-87a4-5f467b1848ce" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:52:20 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:52:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Verify base images {{(pid=74892) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Image id 557dbecf-dbbd-46c7-999f-66066c1bea36 yields fingerprint 8e67bbe8102412e57db254306df29a81623dac7e {{(pid=74892) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 14:52:34 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] image 557dbecf-dbbd-46c7-999f-66066c1bea36 at (/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e): checking
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] image 557dbecf-dbbd-46c7-999f-66066c1bea36 at (/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e): image is in use {{(pid=74892) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74892) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Image id 7f67e253-f924-47bd-bbf2-9dcd0c0ce012 yields fingerprint b9ec4204a30aceafd59ffff7966da48ac5dad51b {{(pid=74892) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 14:52:34 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] image 7f67e253-f924-47bd-bbf2-9dcd0c0ce012 at (/opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b): checking
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] image 7f67e253-f924-47bd-bbf2-9dcd0c0ce012 at (/opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b): image is in use {{(pid=74892) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] 63270d07-97b5-4d60-87a4-5f467b1848ce is a valid instance name {{(pid=74892) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] 63270d07-97b5-4d60-87a4-5f467b1848ce has a disk file {{(pid=74892) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 63270d07-97b5-4d60-87a4-5f467b1848ce is backed by b9ec4204a30aceafd59ffff7966da48ac5dad51b {{(pid=74892) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] 3b6bb6ef-4936-4598-b95c-cc5f501c2737 is a valid instance name {{(pid=74892) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] 3b6bb6ef-4936-4598-b95c-cc5f501c2737 has a disk file {{(pid=74892) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 14:52:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 is backed by 8e67bbe8102412e57db254306df29a81623dac7e {{(pid=74892) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 14:52:35 user nova-compute[74892]: WARNING nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b
Nov 15 14:52:35 user nova-compute[74892]: WARNING nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56
Nov 15 14:52:35 user nova-compute[74892]: WARNING nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011
Nov 15 14:52:35 user nova-compute[74892]: WARNING nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567
Nov 15 14:52:35 user nova-compute[74892]: WARNING nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c
Nov 15 14:52:35 user nova-compute[74892]: WARNING nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Unknown base file: /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43
Nov 15 14:52:35 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Active base files: /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e /opt/stack/data/nova/instances/_base/b9ec4204a30aceafd59ffff7966da48ac5dad51b
Nov 15 14:52:35 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Removable base files: /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56 /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011 /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567 /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43
Nov 15 14:52:35 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ce8aa6149197ab116a29f8b6c3059009603b2e4b
Nov 15 14:52:35 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c48dae5ca0d60b22cc3272f039b58cdff47c6c56
Nov 15 14:52:35 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/54147bef662088e8fea911ce7b37b896dc530011
Nov 15 14:52:35 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6b4be11e5bee6b04d3e5da3e4f7066246a9ba567
Nov 15 14:52:35 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5c25142bc341047bc12f03d85488fc843a76b74c
Nov 15 14:52:35 user nova-compute[74892]: INFO nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/86ed8aeff7bd27845c8d7f9e550f2b374e65cf43
Nov 15 14:52:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Verification complete {{(pid=74892) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 14:52:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Verify swap images {{(pid=74892) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 14:52:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.imagecache [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Verify ephemeral images {{(pid=74892) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 14:52:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:52:40 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 63270d07-97b5-4d60-87a4-5f467b1848ce is timed out.
Nov 15 14:52:40 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully detached device vdb from instance 63270d07-97b5-4d60-87a4-5f467b1848ce from the live domain config.
Nov 15 14:52:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THakhgzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:52:40 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc555a35-0ba6-40ab-92c7-282ec86f980e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:52:40 user nova-compute[74892]: No targets found.
Nov 15 14:52:40 user nova-compute[74892]: iSNS:
Nov 15 14:52:40 user nova-compute[74892]: No targets found.
Nov 15 14:52:40 user nova-compute[74892]: STATIC:
Nov 15 14:52:40 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907
Nov 15 14:52:40 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:52:40 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:52:40 user nova-compute[74892]: FIRMWARE:
Nov 15 14:52:40 user nova-compute[74892]: No targets found.
Nov 15 14:52:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:52:40 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:52:40 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dfb171-fefb-4f84-b475-403a3737b660]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0699b4a-c8eb-42d2-92f0-95bf08a617c2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:52:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 (non-flash)
Nov 15 14:52:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd005f0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a1f468-fafb-4046-8b1e-3ec1619dbe66]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f0c02-327f-4f62-9a56-276c004cdb5e]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2dd05f-1e9f-4bc4-b343-29aeb7ccd1f9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3510a0-8269-4df6-97df-aa81cf904dfa]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a17777-a8ad-4404-b7cb-597bc937ef5d]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32fc4b0-e08a-4980-ba75-2e4aa3f910b7]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260]
Nov 15 14:52:40 user nova-compute[74892]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907, portal: 172.16.0.220,3260] successful.
Nov 15 14:52:40 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee75c3bb-5bb5-417d-9063-b160a3f82907 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[787a5d8a-157d-4432-bcef-c886d4452d72]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] <== disconnect_volume: return (314ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:52:40 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:52:41 user nova-compute[74892]: DEBUG nova.objects.instance [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'flavor' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:52:41 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-21d027ce-c837-4f08-ac69-c13db948cc0e tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.685s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:52:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:52:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:52:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:52:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:53:08 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:53:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:53:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:53:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:53:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:53:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:53:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:53:09 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:10 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:53:10 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:53:10 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=25.013957977294922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:11 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 63270d07-97b5-4d60-87a4-5f467b1848ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:53:11 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:53:11 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:53:11 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:53:11 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:53:11 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:53:11 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:53:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:12 user nova-compute[74892]: INFO nova.compute.manager [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Terminating instance
Nov 15 14:53:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-b8c85100-2c86-4a40-a33c-9f9312bd5078 req-96ddc1b8-11a3-4f98-abee-631d25d8c7f1 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-unplugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b8c85100-2c86-4a40-a33c-9f9312bd5078 req-96ddc1b8-11a3-4f98-abee-631d25d8c7f1 service nova] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b8c85100-2c86-4a40-a33c-9f9312bd5078 req-96ddc1b8-11a3-4f98-abee-631d25d8c7f1 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-b8c85100-2c86-4a40-a33c-9f9312bd5078 req-96ddc1b8-11a3-4f98-abee-631d25d8c7f1 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-b8c85100-2c86-4a40-a33c-9f9312bd5078 req-96ddc1b8-11a3-4f98-abee-631d25d8c7f1 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] No waiting events found dispatching network-vif-unplugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-b8c85100-2c86-4a40-a33c-9f9312bd5078 req-96ddc1b8-11a3-4f98-abee-631d25d8c7f1 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-unplugged-54fccf43-8fcf-4679-9a9d-d4d118b17def for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:53:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Instance destroyed successfully.
Nov 15 14:53:12 user nova-compute[74892]: DEBUG nova.objects.instance [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'resources' on Instance uuid 63270d07-97b5-4d60-87a4-5f467b1848ce {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-398515450',display_name='tempest-TestMinimumBasicScenario-server-398515450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-398515450',id=49,image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKXBSEUcUUjM+c/6DXEyeDoRu9sW++oIrxWLt2Glm3/CgxEC0XfGeZLW4jlg6pjb83+3q4ykt17mjRPCCBPAqZ6IWiqkA25Q6PCiojESRTF80uMzOFTtxd1rGqVxQ2Ntg==',key_name='tempest-TestMinimumBasicScenario-465543366',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:48:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-rfrp3aye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7f67e253-f924-47bd-bbf2-9dcd0c0ce012',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:50:34Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=63270d07-97b5-4d60-87a4-5f467b1848ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "address": "fa:16:3e:16:7a:42", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fccf43-8f", "ovs_interfaceid": "54fccf43-8fcf-4679-9a9d-d4d118b17def", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG os_vif [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54fccf43-8f, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e5fe788-dec7-4886-a3fc-a1481388fcc6) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:53:12 user nova-compute[74892]: INFO os_vif [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:7a:42,bridge_name='br-int',has_traffic_filtering=True,id=54fccf43-8fcf-4679-9a9d-d4d118b17def,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fccf43-8f')
Nov 15 14:53:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Deleting instance files /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce_del
Nov 15 14:53:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Deletion of /opt/stack/data/nova/instances/63270d07-97b5-4d60-87a4-5f467b1848ce_del complete
Nov 15 14:53:13 user nova-compute[74892]: INFO nova.compute.manager [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:53:13 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Took 0.55 seconds to deallocate network for instance.
Nov 15 14:53:13 user nova-compute[74892]: DEBUG nova.compute.manager [req-bfd84b9d-a0e7-4d01-8308-1c0a06b9c8b1 req-3b95e312-12dd-43b4-be0a-ff5e9b9a2b3a service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-deleted-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:13 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Deleted allocations for instance 63270d07-97b5-4d60-87a4-5f467b1848ce
Nov 15 14:53:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-e8ee8177-a0a0-4c30-840f-bb8499f7ba5f tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.709s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-71c55d11-5422-403b-b76a-7c16ae192632 req-041242fb-c97b-49b4-ae15-2eba38649d86 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:53:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-71c55d11-5422-403b-b76a-7c16ae192632 req-041242fb-c97b-49b4-ae15-2eba38649d86 service nova] Acquiring lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-71c55d11-5422-403b-b76a-7c16ae192632 req-041242fb-c97b-49b4-ae15-2eba38649d86 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-71c55d11-5422-403b-b76a-7c16ae192632 req-041242fb-c97b-49b4-ae15-2eba38649d86 service nova] Lock "63270d07-97b5-4d60-87a4-5f467b1848ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-71c55d11-5422-403b-b76a-7c16ae192632 req-041242fb-c97b-49b4-ae15-2eba38649d86 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] No waiting events found dispatching network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:53:14 user nova-compute[74892]: WARNING nova.compute.manager [req-71c55d11-5422-403b-b76a-7c16ae192632 req-041242fb-c97b-49b4-ae15-2eba38649d86 service nova] [instance: 63270d07-97b5-4d60-87a4-5f467b1848ce] Received unexpected event network-vif-plugged-54fccf43-8fcf-4679-9a9d-d4d118b17def for instance with vm_state deleted and task_state None.
Nov 15 14:53:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:19 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-778f8bdf-6272-4502-8dcb-e4f696f32ff7 req-ce4e598b-baf5-4ae8-acd6-41ef591c4834 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-changed-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-778f8bdf-6272-4502-8dcb-e4f696f32ff7 req-ce4e598b-baf5-4ae8-acd6-41ef591c4834 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Refreshing instance network info cache due to event network-changed-834d556d-6325-4227-9ceb-9206cc18ae86. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-778f8bdf-6272-4502-8dcb-e4f696f32ff7 req-ce4e598b-baf5-4ae8-acd6-41ef591c4834 service nova] Acquiring lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-778f8bdf-6272-4502-8dcb-e4f696f32ff7 req-ce4e598b-baf5-4ae8-acd6-41ef591c4834 service nova] Acquired lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG nova.network.neutron [req-778f8bdf-6272-4502-8dcb-e4f696f32ff7 req-ce4e598b-baf5-4ae8-acd6-41ef591c4834 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Refreshing network info cache for port 834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:53:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:23 user nova-compute[74892]: DEBUG nova.network.neutron [req-778f8bdf-6272-4502-8dcb-e4f696f32ff7 req-ce4e598b-baf5-4ae8-acd6-41ef591c4834 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updated VIF entry in instance network info cache for port 834d556d-6325-4227-9ceb-9206cc18ae86. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:53:23 user nova-compute[74892]: DEBUG nova.network.neutron [req-778f8bdf-6272-4502-8dcb-e4f696f32ff7 req-ce4e598b-baf5-4ae8-acd6-41ef591c4834 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:53:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-778f8bdf-6272-4502-8dcb-e4f696f32ff7 req-ce4e598b-baf5-4ae8-acd6-41ef591c4834 service nova] Releasing lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG nova.objects.instance [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'flavor' on Instance uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:24 user nova-compute[74892]: INFO nova.compute.manager [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Attaching volume 0f4d4b5c-f840-4b28-8bf5-7010dade29f2 to /dev/vdb
Nov 15 14:53:24 user nova-compute[74892]: DEBUG os_brick.utils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192301c-387a-4152-8cdd-81aba47d35d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb5e275-1dfd-41db-83b0-f90f4064f07c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74486bd-a2bb-4525-b301-b3d888384693]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa6c178-eae6-479c-b9dd-d0a52366fd30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:53:24 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:53:24 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dbc562-79eb-4298-adf2-a3ce974a95b6]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG os_brick.utils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:53:24 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating existing volume attachment record: e1fbc411-8960-4aa6-b39c-f3a0bfa75510 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:53:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:27 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:53:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:53:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkbKyqFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:53:29 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:53:29 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:53:29 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da35c72-a944-4f2a-b990-941dd1d30a8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:53:29 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2441ff-911e-495f-8d0b-001f0f79f5a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2] added
Nov 15 14:53:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d76b8a-74ed-4782-a1f1-1570985800d9]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd73473-a866-4c61-953e-c97a1e7e40a0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkbKyqFv {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkbKyqFv" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a2dd03-77d0-4bd7-b7ea-6f22d8117917]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkbKyqFv'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab0ea9f-3fab-43d5-98f5-2594c2c08a96]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c701b-9ba9-40a9-97fb-6f7175f88152]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:53:29 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:53:29 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:53:29 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 14:53:29 user nova-compute[74892]: 
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda6bc86-a4a2-4b12-aff0-817f3d859de0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2, portal: 172.16.0.220,3260]
Nov 15 14:53:29 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2, portal: 172.16.0.220,3260] successful.
Nov 15 14:53:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6a5ec0-8845-42fb-aaab-c5d4d9fcd211]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[413bd6bf-becc-4785-8265-450342535c2f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 (non-flash)
Nov 15 14:53:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 (non-flash)
Nov 15 14:53:29 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a636322-2561-44e0-b77e-ac01a29d5db3]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:29 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:53:30 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:53:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkbKyqFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:53:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:53:30 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23832303765306238', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:53:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832303765306238', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:53:30 user nova-compute[74892]: DEBUG nova.objects.instance [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'flavor' on Instance uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:53:30 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:53:30 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:53:30 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:53:30 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:53:30 user nova-compute[74892]:   <serial>0f4d4b5c-f840-4b28-8bf5-7010dade29f2</serial>
Nov 15 14:53:30 user nova-compute[74892]: </disk>
Nov 15 14:53:30 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:53:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:53:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:53:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No VIF found with MAC fa:16:3e:df:42:c1, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:53:31 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-38ce358d-2c8f-4598-b2eb-9b6420d53f20 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.086s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:33 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:53:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:53:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:53:33 user nova-compute[74892]: INFO nova.compute.manager [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Detaching volume 0f4d4b5c-f840-4b28-8bf5-7010dade29f2
Nov 15 14:53:33 user nova-compute[74892]: INFO nova.virt.block_device [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Attempting to driver detach volume 0f4d4b5c-f840-4b28-8bf5-7010dade29f2 from mountpoint /dev/vdb
Nov 15 14:53:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Attempting to detach device vdb from instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:53:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:53:33 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:53:33 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:53:33 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:53:33 user nova-compute[74892]:   <serial>0f4d4b5c-f840-4b28-8bf5-7010dade29f2</serial>
Nov 15 14:53:33 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:53:33 user nova-compute[74892]: </disk>
Nov 15 14:53:33 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:53:33 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Successfully detached device vdb from instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 from the persistent domain config.
Nov 15 14:53:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:53:33 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:53:33 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:53:33 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:53:33 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:53:33 user nova-compute[74892]:   <serial>0f4d4b5c-f840-4b28-8bf5-7010dade29f2</serial>
Nov 15 14:53:33 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:53:33 user nova-compute[74892]: </disk>
Nov 15 14:53:33 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:53:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:53:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:53:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:53:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:53:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:53:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:53:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:53:54 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 is timed out.
Nov 15 14:53:54 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Successfully detached device vdb from instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 from the live domain config.
Nov 15 14:53:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkbKyqFv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:53:54 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f48d93f-2953-4135-9aed-06a88b9fa990]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:53:54 user nova-compute[74892]: No targets found.
Nov 15 14:53:54 user nova-compute[74892]: iSNS:
Nov 15 14:53:54 user nova-compute[74892]: No targets found.
Nov 15 14:53:54 user nova-compute[74892]: STATIC:
Nov 15 14:53:54 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2
Nov 15 14:53:54 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:53:54 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:53:54 user nova-compute[74892]: FIRMWARE:
Nov 15 14:53:54 user nova-compute[74892]: No targets found.
Nov 15 14:53:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:53:54 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:53:54 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[495308e4-791e-4acd-b7f9-1b954676a9b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a386b9-a7f1-4e1f-a0e5-29f4bfeddb98]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 (non-flash)
Nov 15 14:53:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 (non-flash)
Nov 15 14:53:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd005f3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c296d25-d422-4c79-a3c7-e8822980c7c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac43625-0873-4076-a5a1-4ee6e4709649]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabcddcc-83f5-4b04-9c4d-3e95fdef9db2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[37192901-8b7f-491b-bee8-abea910a30d2]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ac0712-5476-4d30-ae49-4f886371ced8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b221fe8-2b02-4123-951b-666856db91bc]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2, portal: 172.16.0.220,3260]
Nov 15 14:53:54 user nova-compute[74892]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2, portal: 172.16.0.220,3260] successful.
Nov 15 14:53:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f4d4b5c-f840-4b28-8bf5-7010dade29f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2864aa15-5a82-4e61-8aae-04d151323e26]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] <== disconnect_volume: return (264ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:53:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:53:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'flavor' on Instance uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:53:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-51304d30-3def-4300-94b3-fd9f940a0a11 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.571s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:53:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:53:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:54:06 user nova-compute[74892]: INFO nova.compute.claims [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Claim successful on node user
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:54:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.policy [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd87bf1610b740e98fbb88b245301c56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82b93eb8ffe4a2f9ac702406fb1df88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:54:06 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Creating image(s)
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "/opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "/opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "/opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "9f787d9839ff079528d0ca8ce858b486a383e43a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:06 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "9f787d9839ff079528d0ca8ce858b486a383e43a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a.part --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG nova.virt.images [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] 748a5386-1d43-4acb-81c9-cd4ab1ad680a was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a.part /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Successfully created port: fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a.part /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a.converted" returned: 0 in 0.283s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Skipping network cache update for instance because it is Building. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "9f787d9839ff079528d0ca8ce858b486a383e43a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.142s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a --force-share --output=json" returned: 0 in 0.190s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "9f787d9839ff079528d0ca8ce858b486a383e43a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "9f787d9839ff079528d0ca8ce858b486a383e43a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a,backing_fmt=raw /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a,backing_fmt=raw /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk 1073741824" returned: 0 in 0.052s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "9f787d9839ff079528d0ca8ce858b486a383e43a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Successfully updated port: fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquired lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-1d20fe76-97bc-45e1-abbb-a013e96f1779 req-4f22b907-26bf-4196-8343-8127aef94ad5 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.compute.manager [req-1d20fe76-97bc-45e1-abbb-a013e96f1779 req-4f22b907-26bf-4196-8343-8127aef94ad5 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing instance network info cache due to event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1d20fe76-97bc-45e1-abbb-a013e96f1779 req-4f22b907-26bf-4196-8343-8127aef94ad5 service nova] Acquiring lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f787d9839ff079528d0ca8ce858b486a383e43a --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Cannot resize image /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Ensure instance console log exists: /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Releasing lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Instance network_info: |[{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1d20fe76-97bc-45e1-abbb-a013e96f1779 req-4f22b907-26bf-4196-8343-8127aef94ad5 service nova] Acquired lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.neutron [req-1d20fe76-97bc-45e1-abbb-a013e96f1779 req-4f22b907-26bf-4196-8343-8127aef94ad5 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Start _get_guest_xml network_info=[{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:54:03Z,direct_url=<?>,disk_format='qcow2',id=748a5386-1d43-4acb-81c9-cd4ab1ad680a,min_disk=0,min_ram=0,name='tempest-scenario-img--1445996360',owner='e82b93eb8ffe4a2f9ac702406fb1df88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:54:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '748a5386-1d43-4acb-81c9-cd4ab1ad680a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:54:08 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:54:08 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:54:03Z,direct_url=<?>,disk_format='qcow2',id=748a5386-1d43-4acb-81c9-cd4ab1ad680a,min_disk=0,min_ram=0,name='tempest-scenario-img--1445996360',owner='e82b93eb8ffe4a2f9ac702406fb1df88',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:54:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1139138638',display_name='tempest-TestMinimumBasicScenario-server-1139138638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1139138638',id=51,image_ref='748a5386-1d43-4acb-81c9-cd4ab1ad680a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZTHf4SUpiatHACWDynFnTFnBalg4MSAGvAu9uBbruhqga0lj+cDrFiBFmWPWEY6lE8cVbDJlEl3TZKbz4AGGWY6IbNLSnpjWy8w60opwgF9srJKjq/EsD1KUus3zvlww==',key_name='tempest-TestMinimumBasicScenario-1552781996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-flgqnfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='748a5386-1d43-4acb-81c9-cd4ab1ad680a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:54:07Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=c91c867e-9ddd-48d7-8d7c-b2209f0d6670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f0:ac,bridge_name='br-int',has_traffic_filtering=True,id=fcde9364-357d-4e72-9e31-435b1ac14519,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcde9364-35') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'pci_devices' on Instance uuid c91c867e-9ddd-48d7-8d7c-b2209f0d6670 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:54:08 user nova-compute[74892]:   <uuid>c91c867e-9ddd-48d7-8d7c-b2209f0d6670</uuid>
Nov 15 14:54:08 user nova-compute[74892]:   <name>instance-00000033</name>
Nov 15 14:54:08 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:54:08 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:54:08 user nova-compute[74892]:   <metadata>
Nov 15 14:54:08 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:54:08 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:54:08 user nova-compute[74892]:       <nova:name>tempest-TestMinimumBasicScenario-server-1139138638</nova:name>
Nov 15 14:54:08 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:54:08</nova:creationTime>
Nov 15 14:54:08 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:54:08 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:54:08 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:54:08 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:54:08 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:54:08 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:54:08 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:54:08 user nova-compute[74892]:       <nova:owner>
Nov 15 14:54:08 user nova-compute[74892]:         <nova:user uuid="bd87bf1610b740e98fbb88b245301c56">tempest-TestMinimumBasicScenario-363938991-project-member</nova:user>
Nov 15 14:54:08 user nova-compute[74892]:         <nova:project uuid="e82b93eb8ffe4a2f9ac702406fb1df88">tempest-TestMinimumBasicScenario-363938991</nova:project>
Nov 15 14:54:08 user nova-compute[74892]:       </nova:owner>
Nov 15 14:54:08 user nova-compute[74892]:       <nova:root type="image" uuid="748a5386-1d43-4acb-81c9-cd4ab1ad680a"/>
Nov 15 14:54:08 user nova-compute[74892]:       <nova:ports>
Nov 15 14:54:08 user nova-compute[74892]:         <nova:port uuid="fcde9364-357d-4e72-9e31-435b1ac14519">
Nov 15 14:54:08 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 14:54:08 user nova-compute[74892]:         </nova:port>
Nov 15 14:54:08 user nova-compute[74892]:       </nova:ports>
Nov 15 14:54:08 user nova-compute[74892]:     </nova:instance>
Nov 15 14:54:08 user nova-compute[74892]:   </metadata>
Nov 15 14:54:08 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:54:08 user nova-compute[74892]:     <system>
Nov 15 14:54:08 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:54:08 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:54:08 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:54:08 user nova-compute[74892]:       <entry name="serial">c91c867e-9ddd-48d7-8d7c-b2209f0d6670</entry>
Nov 15 14:54:08 user nova-compute[74892]:       <entry name="uuid">c91c867e-9ddd-48d7-8d7c-b2209f0d6670</entry>
Nov 15 14:54:08 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:54:08 user nova-compute[74892]:     </system>
Nov 15 14:54:08 user nova-compute[74892]:   </sysinfo>
Nov 15 14:54:08 user nova-compute[74892]:   <os>
Nov 15 14:54:08 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:54:08 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:54:08 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:54:08 user nova-compute[74892]:   </os>
Nov 15 14:54:08 user nova-compute[74892]:   <features>
Nov 15 14:54:08 user nova-compute[74892]:     <acpi/>
Nov 15 14:54:08 user nova-compute[74892]:     <apic/>
Nov 15 14:54:08 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:54:08 user nova-compute[74892]:   </features>
Nov 15 14:54:08 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:54:08 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:54:08 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:54:08 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:54:08 user nova-compute[74892]:   </clock>
Nov 15 14:54:08 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:54:08 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:54:08 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:54:08 user nova-compute[74892]:   </cpu>
Nov 15 14:54:08 user nova-compute[74892]:   <devices>
Nov 15 14:54:08 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:54:08 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:54:08 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk"/>
Nov 15 14:54:08 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:54:08 user nova-compute[74892]:     </disk>
Nov 15 14:54:08 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:54:08 user nova-compute[74892]:       <mac address="fa:16:3e:cc:f0:ac"/>
Nov 15 14:54:08 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:54:08 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:54:08 user nova-compute[74892]:       <target dev="tapfcde9364-35"/>
Nov 15 14:54:08 user nova-compute[74892]:     </interface>
Nov 15 14:54:08 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:54:08 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/console.log" append="off"/>
Nov 15 14:54:08 user nova-compute[74892]:     </serial>
Nov 15 14:54:08 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:54:08 user nova-compute[74892]:     <video>
Nov 15 14:54:08 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:54:08 user nova-compute[74892]:     </video>
Nov 15 14:54:08 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:54:08 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:54:08 user nova-compute[74892]:     </rng>
Nov 15 14:54:08 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:54:08 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:54:08 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:54:08 user nova-compute[74892]:     </memballoon>
Nov 15 14:54:08 user nova-compute[74892]:   </devices>
Nov 15 14:54:08 user nova-compute[74892]: </domain>
Nov 15 14:54:08 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1139138638',display_name='tempest-TestMinimumBasicScenario-server-1139138638',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1139138638',id=51,image_ref='748a5386-1d43-4acb-81c9-cd4ab1ad680a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZTHf4SUpiatHACWDynFnTFnBalg4MSAGvAu9uBbruhqga0lj+cDrFiBFmWPWEY6lE8cVbDJlEl3TZKbz4AGGWY6IbNLSnpjWy8w60opwgF9srJKjq/EsD1KUus3zvlww==',key_name='tempest-TestMinimumBasicScenario-1552781996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-flgqnfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='748a5386-1d43-4acb-81c9-cd4ab1ad680a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:54:07Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=c91c867e-9ddd-48d7-8d7c-b2209f0d6670,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f0:ac,bridge_name='br-int',has_traffic_filtering=True,id=fcde9364-357d-4e72-9e31-435b1ac14519,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcde9364-35') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG os_vif [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f0:ac,bridge_name='br-int',has_traffic_filtering=True,id=fcde9364-357d-4e72-9e31-435b1ac14519,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcde9364-35') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b8e37b8-0baa-5078-bd8d-7907caef9660', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcde9364-35, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcde9364-35, col_values=(('qos', UUID('d8e3a881-4a62-4dab-b3c4-8bf1dd54a998')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcde9364-35, col_values=(('external_ids', {'iface-id': 'fcde9364-357d-4e72-9e31-435b1ac14519', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:f0:ac', 'vm-uuid': 'c91c867e-9ddd-48d7-8d7c-b2209f0d6670'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:08 user nova-compute[74892]: INFO os_vif [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:f0:ac,bridge_name='br-int',has_traffic_filtering=True,id=fcde9364-357d-4e72-9e31-435b1ac14519,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcde9364-35')
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:54:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No VIF found with MAC fa:16:3e:cc:f0:ac, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:54:09 user nova-compute[74892]: DEBUG nova.network.neutron [req-1d20fe76-97bc-45e1-abbb-a013e96f1779 req-4f22b907-26bf-4196-8343-8127aef94ad5 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updated VIF entry in instance network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:54:09 user nova-compute[74892]: DEBUG nova.network.neutron [req-1d20fe76-97bc-45e1-abbb-a013e96f1779 req-4f22b907-26bf-4196-8343-8127aef94ad5 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:54:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1d20fe76-97bc-45e1-abbb-a013e96f1779 req-4f22b907-26bf-4196-8343-8127aef94ad5 service nova] Releasing lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3ec3cec-f057-4767-a7b5-198da5a7e729 req-ac645e6c-80bc-4c04-a29c-edc3d43d080f service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3ec3cec-f057-4767-a7b5-198da5a7e729 req-ac645e6c-80bc-4c04-a29c-edc3d43d080f service nova] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3ec3cec-f057-4767-a7b5-198da5a7e729 req-ac645e6c-80bc-4c04-a29c-edc3d43d080f service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c3ec3cec-f057-4767-a7b5-198da5a7e729 req-ac645e6c-80bc-4c04-a29c-edc3d43d080f service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG nova.compute.manager [req-c3ec3cec-f057-4767-a7b5-198da5a7e729 req-ac645e6c-80bc-4c04-a29c-edc3d43d080f service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] No waiting events found dispatching network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:54:10 user nova-compute[74892]: WARNING nova.compute.manager [req-c3ec3cec-f057-4767-a7b5-198da5a7e729 req-ac645e6c-80bc-4c04-a29c-edc3d43d080f service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received unexpected event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 for instance with vm_state building and task_state spawning.
Nov 15 14:54:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid c91c867e-9ddd-48d7-8d7c-b2209f0d6670 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:11 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:54:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:54:12 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Instance spawned successfully.
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:54:12 user nova-compute[74892]: INFO nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-a222ef84-9445-4bfe-8469-d6741e00c29b req-bcb1eaaa-d2c5-4d1e-b91e-7196a8698a30 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a222ef84-9445-4bfe-8469-d6741e00c29b req-bcb1eaaa-d2c5-4d1e-b91e-7196a8698a30 service nova] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a222ef84-9445-4bfe-8469-d6741e00c29b req-bcb1eaaa-d2c5-4d1e-b91e-7196a8698a30 service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-a222ef84-9445-4bfe-8469-d6741e00c29b req-bcb1eaaa-d2c5-4d1e-b91e-7196a8698a30 service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-a222ef84-9445-4bfe-8469-d6741e00c29b req-bcb1eaaa-d2c5-4d1e-b91e-7196a8698a30 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] No waiting events found dispatching network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:54:12 user nova-compute[74892]: WARNING nova.compute.manager [req-a222ef84-9445-4bfe-8469-d6741e00c29b req-bcb1eaaa-d2c5-4d1e-b91e-7196a8698a30 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received unexpected event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 for instance with vm_state building and task_state spawning.
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:12 user nova-compute[74892]: INFO nova.compute.manager [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Took 6.29 seconds to build instance.
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ae3b3b0b-a6c6-4ea8-812b-8d64c0def159 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.384s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.554s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:12 user nova-compute[74892]: INFO nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:54:12 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8897MB free_disk=25.011001586914062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:14 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:14 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:14 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:14 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:54:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:19 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:54:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:54:27 user nova-compute[74892]: INFO nova.compute.manager [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] instance snapshotting
Nov 15 14:54:27 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Beginning live snapshot process
Nov 15 14:54:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json -f qcow2 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json -f qcow2 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpol6xn_9f/3e1e7f555c70403b80ba32209ee88de4.delta 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:27 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpol6xn_9f/3e1e7f555c70403b80ba32209ee88de4.delta 1073741824" returned: 0 in 0.059s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:27 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 14:54:28 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:54:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:29 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74892) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 14:54:29 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 14:54:29 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:54:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpol6xn_9f/3e1e7f555c70403b80ba32209ee88de4.delta /opt/stack/data/nova/instances/snapshots/tmpol6xn_9f/3e1e7f555c70403b80ba32209ee88de4 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:29 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpol6xn_9f/3e1e7f555c70403b80ba32209ee88de4.delta /opt/stack/data/nova/instances/snapshots/tmpol6xn_9f/3e1e7f555c70403b80ba32209ee88de4" returned: 0 in 0.273s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:29 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Snapshot extracted, beginning image upload
Nov 15 14:54:31 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Snapshot image upload complete
Nov 15 14:54:31 user nova-compute[74892]: INFO nova.compute.manager [None req-9c291c0b-43d9-4ddf-9b2b-b48a68c0644f tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Took 4.72 seconds to snapshot the instance on the hypervisor.
Nov 15 14:54:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 14:54:33 user nova-compute[74892]: INFO nova.compute.claims [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Claim successful on node user
Nov 15 14:54:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:33 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 14:54:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 14:54:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG nova.policy [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e10a3f0b4f784132a7b721651117c7b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39d5cbe17d4c49329687b3b42e8e1d74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 14:54:34 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Creating image(s)
Nov 15 14:54:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "/opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "/opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "432e307044376f67b75b002f4133e00ca56fba6f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "432e307044376f67b75b002f4133e00ca56fba6f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f.part --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Successfully created port: 40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 14:54:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f.part --force-share --output=json" returned: 0 in 0.193s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.virt.images [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] 261921f8-c58f-4e29-b3ca-1eb81aba3291 was qcow2, converting to raw {{(pid=74892) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.privsep.utils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74892) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f.part /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f.converted {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f.part /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f.converted" returned: 0 in 0.261s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f.converted --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Successfully updated port: 40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquired lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-282ff7ee-d86f-4dbb-b4e4-7f2012727e47 req-5af8ac72-3282-4bc4-967b-87b815be3742 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-changed-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.compute.manager [req-282ff7ee-d86f-4dbb-b4e4-7f2012727e47 req-5af8ac72-3282-4bc4-967b-87b815be3742 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Refreshing instance network info cache due to event network-changed-40745894-4292-455a-b5cc-377c6ad3cdac. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-282ff7ee-d86f-4dbb-b4e4-7f2012727e47 req-5af8ac72-3282-4bc4-967b-87b815be3742 service nova] Acquiring lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "432e307044376f67b75b002f4133e00ca56fba6f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.418s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "432e307044376f67b75b002f4133e00ca56fba6f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "432e307044376f67b75b002f4133e00ca56fba6f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.network.neutron [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updating instance_info_cache with network_info: [{"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f --force-share --output=json" returned: 0 in 0.169s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f,backing_fmt=raw /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Releasing lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:54:35 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Instance network_info: |[{"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-282ff7ee-d86f-4dbb-b4e4-7f2012727e47 req-5af8ac72-3282-4bc4-967b-87b815be3742 service nova] Acquired lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.network.neutron [req-282ff7ee-d86f-4dbb-b4e4-7f2012727e47 req-5af8ac72-3282-4bc4-967b-87b815be3742 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Refreshing network info cache for port 40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f,backing_fmt=raw /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk 1073741824" returned: 0 in 0.047s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "432e307044376f67b75b002f4133e00ca56fba6f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/432e307044376f67b75b002f4133e00ca56fba6f --force-share --output=json" returned: 0 in 0.175s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Ensure instance console log exists: /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Start _get_guest_xml network_info=[{"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b7f0e97f8e61a663077fffbb978b043f',container_format='bare',created_at=2023-11-15T14:54:27Z,direct_url=<?>,disk_format='qcow2',id=261921f8-c58f-4e29-b3ca-1eb81aba3291,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-499226225',owner='39d5cbe17d4c49329687b3b42e8e1d74',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T14:54:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '261921f8-c58f-4e29-b3ca-1eb81aba3291'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 14:54:36 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:54:36 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b7f0e97f8e61a663077fffbb978b043f',container_format='bare',created_at=2023-11-15T14:54:27Z,direct_url=<?>,disk_format='qcow2',id=261921f8-c58f-4e29-b3ca-1eb81aba3291,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-499226225',owner='39d5cbe17d4c49329687b3b42e8e1d74',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T14:54:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-625113073',display_name='tempest-TestStampPattern-server-625113073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-625113073',id=52,image_ref='261921f8-c58f-4e29-b3ca-1eb81aba3291',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPeJ0IXGEcJc61O3mU1/dq8f65qXLLR6+kEyh+NghLrhciWvaUXjA1cbWnVhtXJ0Ufufr1m2LL7P+vg+oA9LDz7J65DDQ6e7gmbZegj/iYeF3EM5sjDlLEJGrRKf+31A==',key_name='tempest-TestStampPattern-983974885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39d5cbe17d4c49329687b3b42e8e1d74',ramdisk_id='',reservation_id='r-4uepsqj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3b6bb6ef-4936-4598-b95c-cc5f501c2737',image_min_disk='1',image_min_ram='0',image_owner_id='39d5cbe17d4c49329687b3b42e8e1d74',image_owner_project_name='tempest-TestStampPattern-665647939',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-665647939-project-member',image_user_id='e10a3f0b4f784132a7b721651117c7b2',network_allocated='True',owner_project_name='tempest-TestStampPattern-665647939',owner_user_name='tempest-TestStampPattern-665647939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:54:34Z,user_data=None,user_id='e10a3f0b4f784132a7b721651117c7b2',uuid=ddac7225-078f-4a64-99ea-7987eb630b4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converting VIF {"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:6e:47,bridge_name='br-int',has_traffic_filtering=True,id=40745894-4292-455a-b5cc-377c6ad3cdac,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40745894-42') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.objects.instance [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'pci_devices' on Instance uuid ddac7225-078f-4a64-99ea-7987eb630b4d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 14:54:36 user nova-compute[74892]:   <uuid>ddac7225-078f-4a64-99ea-7987eb630b4d</uuid>
Nov 15 14:54:36 user nova-compute[74892]:   <name>instance-00000034</name>
Nov 15 14:54:36 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 14:54:36 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 14:54:36 user nova-compute[74892]:   <metadata>
Nov 15 14:54:36 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 14:54:36 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 14:54:36 user nova-compute[74892]:       <nova:name>tempest-TestStampPattern-server-625113073</nova:name>
Nov 15 14:54:36 user nova-compute[74892]:       <nova:creationTime>2023-11-15 14:54:36</nova:creationTime>
Nov 15 14:54:36 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 14:54:36 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 14:54:36 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 14:54:36 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 14:54:36 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 14:54:36 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 14:54:36 user nova-compute[74892]:       </nova:flavor>
Nov 15 14:54:36 user nova-compute[74892]:       <nova:owner>
Nov 15 14:54:36 user nova-compute[74892]:         <nova:user uuid="e10a3f0b4f784132a7b721651117c7b2">tempest-TestStampPattern-665647939-project-member</nova:user>
Nov 15 14:54:36 user nova-compute[74892]:         <nova:project uuid="39d5cbe17d4c49329687b3b42e8e1d74">tempest-TestStampPattern-665647939</nova:project>
Nov 15 14:54:36 user nova-compute[74892]:       </nova:owner>
Nov 15 14:54:36 user nova-compute[74892]:       <nova:root type="image" uuid="261921f8-c58f-4e29-b3ca-1eb81aba3291"/>
Nov 15 14:54:36 user nova-compute[74892]:       <nova:ports>
Nov 15 14:54:36 user nova-compute[74892]:         <nova:port uuid="40745894-4292-455a-b5cc-377c6ad3cdac">
Nov 15 14:54:36 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 14:54:36 user nova-compute[74892]:         </nova:port>
Nov 15 14:54:36 user nova-compute[74892]:       </nova:ports>
Nov 15 14:54:36 user nova-compute[74892]:     </nova:instance>
Nov 15 14:54:36 user nova-compute[74892]:   </metadata>
Nov 15 14:54:36 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 14:54:36 user nova-compute[74892]:     <system>
Nov 15 14:54:36 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 14:54:36 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 14:54:36 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 14:54:36 user nova-compute[74892]:       <entry name="serial">ddac7225-078f-4a64-99ea-7987eb630b4d</entry>
Nov 15 14:54:36 user nova-compute[74892]:       <entry name="uuid">ddac7225-078f-4a64-99ea-7987eb630b4d</entry>
Nov 15 14:54:36 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 14:54:36 user nova-compute[74892]:     </system>
Nov 15 14:54:36 user nova-compute[74892]:   </sysinfo>
Nov 15 14:54:36 user nova-compute[74892]:   <os>
Nov 15 14:54:36 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 14:54:36 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 14:54:36 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 14:54:36 user nova-compute[74892]:   </os>
Nov 15 14:54:36 user nova-compute[74892]:   <features>
Nov 15 14:54:36 user nova-compute[74892]:     <acpi/>
Nov 15 14:54:36 user nova-compute[74892]:     <apic/>
Nov 15 14:54:36 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 14:54:36 user nova-compute[74892]:   </features>
Nov 15 14:54:36 user nova-compute[74892]:   <clock offset="utc">
Nov 15 14:54:36 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 14:54:36 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 14:54:36 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 14:54:36 user nova-compute[74892]:   </clock>
Nov 15 14:54:36 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 14:54:36 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 14:54:36 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 14:54:36 user nova-compute[74892]:   </cpu>
Nov 15 14:54:36 user nova-compute[74892]:   <devices>
Nov 15 14:54:36 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 14:54:36 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 14:54:36 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk"/>
Nov 15 14:54:36 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 14:54:36 user nova-compute[74892]:     </disk>
Nov 15 14:54:36 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 14:54:36 user nova-compute[74892]:       <mac address="fa:16:3e:54:6e:47"/>
Nov 15 14:54:36 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:54:36 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 14:54:36 user nova-compute[74892]:       <target dev="tap40745894-42"/>
Nov 15 14:54:36 user nova-compute[74892]:     </interface>
Nov 15 14:54:36 user nova-compute[74892]:     <serial type="pty">
Nov 15 14:54:36 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/console.log" append="off"/>
Nov 15 14:54:36 user nova-compute[74892]:     </serial>
Nov 15 14:54:36 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 14:54:36 user nova-compute[74892]:     <video>
Nov 15 14:54:36 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 14:54:36 user nova-compute[74892]:     </video>
Nov 15 14:54:36 user nova-compute[74892]:     <rng model="virtio">
Nov 15 14:54:36 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 14:54:36 user nova-compute[74892]:     </rng>
Nov 15 14:54:36 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 14:54:36 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 14:54:36 user nova-compute[74892]:       <stats period="10"/>
Nov 15 14:54:36 user nova-compute[74892]:     </memballoon>
Nov 15 14:54:36 user nova-compute[74892]:   </devices>
Nov 15 14:54:36 user nova-compute[74892]: </domain>
Nov 15 14:54:36 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-625113073',display_name='tempest-TestStampPattern-server-625113073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-625113073',id=52,image_ref='261921f8-c58f-4e29-b3ca-1eb81aba3291',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPeJ0IXGEcJc61O3mU1/dq8f65qXLLR6+kEyh+NghLrhciWvaUXjA1cbWnVhtXJ0Ufufr1m2LL7P+vg+oA9LDz7J65DDQ6e7gmbZegj/iYeF3EM5sjDlLEJGrRKf+31A==',key_name='tempest-TestStampPattern-983974885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39d5cbe17d4c49329687b3b42e8e1d74',ramdisk_id='',reservation_id='r-4uepsqj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3b6bb6ef-4936-4598-b95c-cc5f501c2737',image_min_disk='1',image_min_ram='0',image_owner_id='39d5cbe17d4c49329687b3b42e8e1d74',image_owner_project_name='tempest-TestStampPattern-665647939',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-665647939-project-member',image_user_id='e10a3f0b4f784132a7b721651117c7b2',network_allocated='True',owner_project_name='tempest-TestStampPattern-665647939',owner_user_name='tempest-TestStampPattern-665647939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T14:54:34Z,user_data=None,user_id='e10a3f0b4f784132a7b721651117c7b2',uuid=ddac7225-078f-4a64-99ea-7987eb630b4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converting VIF {"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:6e:47,bridge_name='br-int',has_traffic_filtering=True,id=40745894-4292-455a-b5cc-377c6ad3cdac,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40745894-42') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG os_vif [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:6e:47,bridge_name='br-int',has_traffic_filtering=True,id=40745894-4292-455a-b5cc-377c6ad3cdac,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40745894-42') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a510f8e1-87e5-5259-956a-5ed084842e30', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap40745894-42, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap40745894-42, col_values=(('qos', UUID('eb44c226-b8f4-4a8b-b7d4-1fdbed30e46f')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap40745894-42, col_values=(('external_ids', {'iface-id': '40745894-4292-455a-b5cc-377c6ad3cdac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:6e:47', 'vm-uuid': 'ddac7225-078f-4a64-99ea-7987eb630b4d'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:36 user nova-compute[74892]: INFO os_vif [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:6e:47,bridge_name='br-int',has_traffic_filtering=True,id=40745894-4292-455a-b5cc-377c6ad3cdac,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40745894-42')
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No VIF found with MAC fa:16:3e:54:6e:47, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.network.neutron [req-282ff7ee-d86f-4dbb-b4e4-7f2012727e47 req-5af8ac72-3282-4bc4-967b-87b815be3742 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updated VIF entry in instance network info cache for port 40745894-4292-455a-b5cc-377c6ad3cdac. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG nova.network.neutron [req-282ff7ee-d86f-4dbb-b4e4-7f2012727e47 req-5af8ac72-3282-4bc4-967b-87b815be3742 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updating instance_info_cache with network_info: [{"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:54:36 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-282ff7ee-d86f-4dbb-b4e4-7f2012727e47 req-5af8ac72-3282-4bc4-967b-87b815be3742 service nova] Releasing lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-9b16c1d5-f537-4d92-854c-a3cb402708a6 req-81e1d511-92b0-4fdd-9662-a409d8111a87 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9b16c1d5-f537-4d92-854c-a3cb402708a6 req-81e1d511-92b0-4fdd-9662-a409d8111a87 service nova] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9b16c1d5-f537-4d92-854c-a3cb402708a6 req-81e1d511-92b0-4fdd-9662-a409d8111a87 service nova] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-9b16c1d5-f537-4d92-854c-a3cb402708a6 req-81e1d511-92b0-4fdd-9662-a409d8111a87 service nova] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-9b16c1d5-f537-4d92-854c-a3cb402708a6 req-81e1d511-92b0-4fdd-9662-a409d8111a87 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] No waiting events found dispatching network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:54:37 user nova-compute[74892]: WARNING nova.compute.manager [req-9b16c1d5-f537-4d92-854c-a3cb402708a6 req-81e1d511-92b0-4fdd-9662-a409d8111a87 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received unexpected event network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac for instance with vm_state building and task_state spawning.
Nov 15 14:54:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 14:54:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 14:54:39 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Instance spawned successfully.
Nov 15 14:54:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 14:54:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:54:39 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 14:54:39 user nova-compute[74892]: INFO nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 15 14:54:39 user nova-compute[74892]: DEBUG nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:54:39 user nova-compute[74892]: INFO nova.compute.manager [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Took 6.19 seconds to build instance.
Nov 15 14:54:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-c1352db1-da03-4861-b6dc-e5602ca8bc41 req-826643ad-d35b-46bf-99df-68e0d8e1de93 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:54:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c1352db1-da03-4861-b6dc-e5602ca8bc41 req-826643ad-d35b-46bf-99df-68e0d8e1de93 service nova] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:54:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c1352db1-da03-4861-b6dc-e5602ca8bc41 req-826643ad-d35b-46bf-99df-68e0d8e1de93 service nova] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:54:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c1352db1-da03-4861-b6dc-e5602ca8bc41 req-826643ad-d35b-46bf-99df-68e0d8e1de93 service nova] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:39 user nova-compute[74892]: DEBUG nova.compute.manager [req-c1352db1-da03-4861-b6dc-e5602ca8bc41 req-826643ad-d35b-46bf-99df-68e0d8e1de93 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] No waiting events found dispatching network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:54:39 user nova-compute[74892]: WARNING nova.compute.manager [req-c1352db1-da03-4861-b6dc-e5602ca8bc41 req-826643ad-d35b-46bf-99df-68e0d8e1de93 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received unexpected event network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac for instance with vm_state active and task_state None.
Nov 15 14:54:39 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-16b1b458-85ae-4d75-93bd-8a869e454fa6 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.290s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:54:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:54:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:54:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:54:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:54:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:54:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:09 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:55:09 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:55:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:55:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:55:09 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:55:09 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:55:10 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:55:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:55:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:55:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:55:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:55:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:55:11 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:55:11 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:12 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:13 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:55:13 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8693MB free_disk=24.836917877197266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ddac7225-078f-4a64-99ea-7987eb630b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:55:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:55:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:55:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:20 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:55:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:25 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:55:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:55:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:55:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:55:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:55:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:55:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'flavor' on Instance uuid c91c867e-9ddd-48d7-8d7c-b2209f0d6670 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:55:58 user nova-compute[74892]: INFO nova.compute.manager [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Attaching volume 54a28f1c-1a62-48eb-a62c-345cfa0cbead to /dev/vdb
Nov 15 14:55:58 user nova-compute[74892]: DEBUG os_brick.utils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf07d39-dc1c-45c9-a023-ea210a6bb63b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5483708-2b94-4de7-86bf-5517a7477df9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e79a64-e533-4e79-932f-b5bb508d7d93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b40fede-67c5-4689-8d04-916e35f17c15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:55:58 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:55:58 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b1d414-4a87-421d-9eeb-2abb5f58f259]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG os_brick.utils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:55:58 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating existing volume attachment record: 1a53b68b-ca21-46cc-adbd-cf788edc4354 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:56:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkeRjhLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:56:03 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:56:03 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:56:03 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[116ff4f8-21db-4e7b-a5df-1cd3b30f4f60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:56:03 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d145704-2ae2-4d92-8144-3096c7571f00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead] added
Nov 15 14:56:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ec7ea6-5a60-4970-b6bb-a82e80ca6dcb]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ef68e4-86f9-41cc-b8ef-e249c080c140]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkeRjhLM {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NkeRjhLM" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd6553-c692-4504-b0ed-6d68ae3b4801]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NkeRjhLM'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705fa94-a72f-419c-a920-ef9af51c6f17]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d63879d-3ab4-4457-a049-c3f8849adc83]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:56:03 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 14:56:03 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:56:03 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 14:56:03 user nova-compute[74892]: 
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70d61d5-adc4-4f0d-81dc-91bbc622ba6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead, portal: 172.16.0.220,3260]
Nov 15 14:56:03 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead, portal: 172.16.0.220,3260] successful.
Nov 15 14:56:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41be5d3-170a-4678-bf17-73f1a59e20b4]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bcc2d4-655e-47ed-8d48-ad3b00334108]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:56:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:56:03 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b672ecf-91ec-4a0e-a463-bf4300f36fd9]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:56:03 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkeRjhLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:56:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:56:04 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '26139626462373535', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:56:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139626462373535', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:56:04 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'flavor' on Instance uuid c91c867e-9ddd-48d7-8d7c-b2209f0d6670 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:56:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:56:04 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:56:04 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:56:04 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:56:04 user nova-compute[74892]:   <serial>54a28f1c-1a62-48eb-a62c-345cfa0cbead</serial>
Nov 15 14:56:04 user nova-compute[74892]: </disk>
Nov 15 14:56:04 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:56:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:56:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:56:04 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] No VIF found with MAC fa:16:3e:cc:f0:ac, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:56:05 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ab6f014d-52d7-43a0-ab31-4e0681b5952b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.378s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-7e173fae-e901-4dda-b306-6e284db5b06f req-aa225ad1-563f-40ef-a98f-565fbfa47671 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:56:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-7e173fae-e901-4dda-b306-6e284db5b06f req-aa225ad1-563f-40ef-a98f-565fbfa47671 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing instance network info cache due to event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:56:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7e173fae-e901-4dda-b306-6e284db5b06f req-aa225ad1-563f-40ef-a98f-565fbfa47671 service nova] Acquiring lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:56:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7e173fae-e901-4dda-b306-6e284db5b06f req-aa225ad1-563f-40ef-a98f-565fbfa47671 service nova] Acquired lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:56:07 user nova-compute[74892]: DEBUG nova.network.neutron [req-7e173fae-e901-4dda-b306-6e284db5b06f req-aa225ad1-563f-40ef-a98f-565fbfa47671 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:56:07 user nova-compute[74892]: DEBUG nova.network.neutron [req-7e173fae-e901-4dda-b306-6e284db5b06f req-aa225ad1-563f-40ef-a98f-565fbfa47671 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updated VIF entry in instance network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:56:07 user nova-compute[74892]: DEBUG nova.network.neutron [req-7e173fae-e901-4dda-b306-6e284db5b06f req-aa225ad1-563f-40ef-a98f-565fbfa47671 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:56:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7e173fae-e901-4dda-b306-6e284db5b06f req-aa225ad1-563f-40ef-a98f-565fbfa47671 service nova] Releasing lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG nova.compute.manager [req-36fd16c1-88e0-4e71-b079-8aaa8bb29c2a req-c7711549-4154-42db-9186-916f8ecaeebc service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG nova.compute.manager [req-36fd16c1-88e0-4e71-b079-8aaa8bb29c2a req-c7711549-4154-42db-9186-916f8ecaeebc service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing instance network info cache due to event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36fd16c1-88e0-4e71-b079-8aaa8bb29c2a req-c7711549-4154-42db-9186-916f8ecaeebc service nova] Acquiring lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36fd16c1-88e0-4e71-b079-8aaa8bb29c2a req-c7711549-4154-42db-9186-916f8ecaeebc service nova] Acquired lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG nova.network.neutron [req-36fd16c1-88e0-4e71-b079-8aaa8bb29c2a req-c7711549-4154-42db-9186-916f8ecaeebc service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG nova.network.neutron [req-36fd16c1-88e0-4e71-b079-8aaa8bb29c2a req-c7711549-4154-42db-9186-916f8ecaeebc service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updated VIF entry in instance network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG nova.network.neutron [req-36fd16c1-88e0-4e71-b079-8aaa8bb29c2a req-c7711549-4154-42db-9186-916f8ecaeebc service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36fd16c1-88e0-4e71-b079-8aaa8bb29c2a req-c7711549-4154-42db-9186-916f8ecaeebc service nova] Releasing lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:09 user nova-compute[74892]: INFO nova.compute.manager [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Rebooting instance
Nov 15 14:56:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquired lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:56:09 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 14:56:10 user nova-compute[74892]: DEBUG nova.network.neutron [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:56:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Releasing lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:56:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:56:10 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:10 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:56:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:56:10 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:56:10 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:56:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:56:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:56:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:56:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-f6387950-7533-480c-9ba9-713b3d29db3e req-35dfd277-fc34-4f4b-b190-29095f22d9fd service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-unplugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f6387950-7533-480c-9ba9-713b3d29db3e req-35dfd277-fc34-4f4b-b190-29095f22d9fd service nova] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f6387950-7533-480c-9ba9-713b3d29db3e req-35dfd277-fc34-4f4b-b190-29095f22d9fd service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f6387950-7533-480c-9ba9-713b3d29db3e req-35dfd277-fc34-4f4b-b190-29095f22d9fd service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG nova.compute.manager [req-f6387950-7533-480c-9ba9-713b3d29db3e req-35dfd277-fc34-4f4b-b190-29095f22d9fd service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] No waiting events found dispatching network-vif-unplugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:56:12 user nova-compute[74892]: WARNING nova.compute.manager [req-f6387950-7533-480c-9ba9-713b3d29db3e req-35dfd277-fc34-4f4b-b190-29095f22d9fd service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received unexpected event network-vif-unplugged-fcde9364-357d-4e72-9e31-435b1ac14519 for instance with vm_state active and task_state reboot_started.
Nov 15 14:56:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:12 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:56:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:13 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Instance shutdown successfully.
Nov 15 14:56:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-f283b629-c591-4e0b-805c-cfe41ab03373 req-b4b4c16f-b854-402c-a25a-d2dd3f23853f service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:56:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f283b629-c591-4e0b-805c-cfe41ab03373 req-b4b4c16f-b854-402c-a25a-d2dd3f23853f service nova] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f283b629-c591-4e0b-805c-cfe41ab03373 req-b4b4c16f-b854-402c-a25a-d2dd3f23853f service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f283b629-c591-4e0b-805c-cfe41ab03373 req-b4b4c16f-b854-402c-a25a-d2dd3f23853f service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:14 user nova-compute[74892]: DEBUG nova.compute.manager [req-f283b629-c591-4e0b-805c-cfe41ab03373 req-b4b4c16f-b854-402c-a25a-d2dd3f23853f service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] No waiting events found dispatching network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:56:14 user nova-compute[74892]: WARNING nova.compute.manager [req-f283b629-c591-4e0b-805c-cfe41ab03373 req-b4b4c16f-b854-402c-a25a-d2dd3f23853f service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received unexpected event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 for instance with vm_state active and task_state reboot_started.
Nov 15 14:56:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:56:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=24.83551788330078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ddac7225-078f-4a64-99ea-7987eb630b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] No waiting events found dispatching network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:56:16 user nova-compute[74892]: WARNING nova.compute.manager [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received unexpected event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 for instance with vm_state active and task_state reboot_started.
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.manager [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] No waiting events found dispatching network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:56:16 user nova-compute[74892]: WARNING nova.compute.manager [req-12f027bb-a945-4af8-8a11-9bac52871c98 req-7612b525-179f-4616-afc2-d0a666eecfed service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received unexpected event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 for instance with vm_state active and task_state reboot_started.
Nov 15 14:56:16 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Instance running successfully.
Nov 15 14:56:16 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Instance soft rebooted successfully.
Nov 15 14:56:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 14:56:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3cfe8f50-a30e-41bf-a26b-4d10db7fae64 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.284s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:56:20 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-2c9d7ad8-9512-4bc4-a656-75737254be1b req-e317c099-b408-438d-a971-449b977447c9 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-changed-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-2c9d7ad8-9512-4bc4-a656-75737254be1b req-e317c099-b408-438d-a971-449b977447c9 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Refreshing instance network info cache due to event network-changed-40745894-4292-455a-b5cc-377c6ad3cdac. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2c9d7ad8-9512-4bc4-a656-75737254be1b req-e317c099-b408-438d-a971-449b977447c9 service nova] Acquiring lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2c9d7ad8-9512-4bc4-a656-75737254be1b req-e317c099-b408-438d-a971-449b977447c9 service nova] Acquired lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG nova.network.neutron [req-2c9d7ad8-9512-4bc4-a656-75737254be1b req-e317c099-b408-438d-a971-449b977447c9 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Refreshing network info cache for port 40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG nova.network.neutron [req-2c9d7ad8-9512-4bc4-a656-75737254be1b req-e317c099-b408-438d-a971-449b977447c9 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updated VIF entry in instance network info cache for port 40745894-4292-455a-b5cc-377c6ad3cdac. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG nova.network.neutron [req-2c9d7ad8-9512-4bc4-a656-75737254be1b req-e317c099-b408-438d-a971-449b977447c9 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updating instance_info_cache with network_info: [{"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:56:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-2c9d7ad8-9512-4bc4-a656-75737254be1b req-e317c099-b408-438d-a971-449b977447c9 service nova] Releasing lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'flavor' on Instance uuid ddac7225-078f-4a64-99ea-7987eb630b4d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:26 user nova-compute[74892]: INFO nova.compute.manager [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Attaching volume 4234e8d5-1b24-46a2-9667-cd379e4e0a32 to /dev/vdb
Nov 15 14:56:26 user nova-compute[74892]: DEBUG os_brick.utils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a8e1ca-9cf9-4e19-8d3d-0d51afe2f42e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f4c84-2f02-485f-89f5-447a320c6940]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b37a4-4782-4ae5-9bdc-16497f57538f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[973691a4-c022-4c6c-a619-ebc964e59942]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 14:56:26 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 14:56:26 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47ce707-7c2a-4ea3-830e-e8ad5b5dfac2]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG os_brick.utils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:56:26 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updating existing volume attachment record: cae6bf03-b104-4b1c-a8ce-1bbfe8c244fe {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 14:56:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrGbyFZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:56:31 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:56:31 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:56:31 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de5266b-11d9-402a-8077-d7f158c65697]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 14:56:31 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff057d5c-c5dc-411e-959d-92f628ba51fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32] added
Nov 15 14:56:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33594e4-87d0-4498-88aa-c790ccf315eb]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d3c88-2fe2-4379-9605-b9b7b767d5a8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrGbyFZK {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrGbyFZK" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d749cc5f-b8d7-4ee6-8833-6092f1653e06]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WrGbyFZK'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d02da50-6b80-4f56-a8c2-dea8f60c7927]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe03873-f240-44ce-b490-716935580070]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:56:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:56:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbf27fd-f969-45bf-994c-620d6f2e1e1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32, portal: 172.16.0.220,3260]
Nov 15 14:56:31 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32, portal: 172.16.0.220,3260] successful.
Nov 15 14:56:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[23318ff3-f5a2-4331-8eed-dd329e5b17a8]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41dcf83-c93e-48b1-8932-f20df0454981]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:56:31 user nova-compute[74892]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 (non-flash)
Nov 15 14:56:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:56:31 user nova-compute[74892]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 (non-flash)
Nov 15 14:56:31 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[211b32d6-0324-42f0-97e3-ad75fe55ffc4]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrGbyFZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 14:56:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26564633136323138', 'path': '/dev/sdc'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564633136323138', 'path': '/dev/sdc'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG nova.objects.instance [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'flavor' on Instance uuid ddac7225-078f-4a64-99ea-7987eb630b4d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 14:56:32 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:56:32 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:56:32 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:56:32 user nova-compute[74892]:   <serial>4234e8d5-1b24-46a2-9667-cd379e4e0a32</serial>
Nov 15 14:56:32 user nova-compute[74892]: </disk>
Nov 15 14:56:32 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] No VIF found with MAC fa:16:3e:54:6e:47, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 14:56:32 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-c9369d9d-adea-4329-85cd-a54834ed40bd tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.568s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:56:34 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:56:34 user nova-compute[74892]: INFO nova.compute.manager [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Detaching volume 4234e8d5-1b24-46a2-9667-cd379e4e0a32
Nov 15 14:56:35 user nova-compute[74892]: INFO nova.virt.block_device [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Attempting to driver detach volume 4234e8d5-1b24-46a2-9667-cd379e4e0a32 from mountpoint /dev/vdb
Nov 15 14:56:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Attempting to detach device vdb from instance ddac7225-078f-4a64-99ea-7987eb630b4d from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:56:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:56:35 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:56:35 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:56:35 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:56:35 user nova-compute[74892]:   <serial>4234e8d5-1b24-46a2-9667-cd379e4e0a32</serial>
Nov 15 14:56:35 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:56:35 user nova-compute[74892]: </disk>
Nov 15 14:56:35 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:56:35 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Successfully detached device vdb from instance ddac7225-078f-4a64-99ea-7987eb630b4d from the persistent domain config.
Nov 15 14:56:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddac7225-078f-4a64-99ea-7987eb630b4d from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:56:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:56:35 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:56:35 user nova-compute[74892]:   <source dev="/dev/sdc"/>
Nov 15 14:56:35 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:56:35 user nova-compute[74892]:   <serial>4234e8d5-1b24-46a2-9667-cd379e4e0a32</serial>
Nov 15 14:56:35 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:56:35 user nova-compute[74892]: </disk>
Nov 15 14:56:35 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:56:35 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddac7225-078f-4a64-99ea-7987eb630b4d {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:56:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:55 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddac7225-078f-4a64-99ea-7987eb630b4d is timed out.
Nov 15 14:56:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Successfully detached device vdb from instance ddac7225-078f-4a64-99ea-7987eb630b4d from the live domain config.
Nov 15 14:56:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrGbyFZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:56:55 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[068976e8-adc2-4de0-b053-8c1d08affd29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:56:55 user nova-compute[74892]: No targets found.
Nov 15 14:56:55 user nova-compute[74892]: iSNS:
Nov 15 14:56:55 user nova-compute[74892]: No targets found.
Nov 15 14:56:55 user nova-compute[74892]: STATIC:
Nov 15 14:56:55 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead
Nov 15 14:56:55 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:56:55 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:56:55 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32
Nov 15 14:56:55 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:56:55 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:56:55 user nova-compute[74892]: FIRMWARE:
Nov 15 14:56:55 user nova-compute[74892]: No targets found.
Nov 15 14:56:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:56:55 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:56:55 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d307e1c-cbf4-4510-83ef-cb19848f4280]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13820ca-bea9-4814-9234-ca6731911168]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:56:55 user nova-compute[74892]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 (non-flash)
Nov 15 14:56:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:56:55 user nova-compute[74892]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 (non-flash)
Nov 15 14:56:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd0062b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32'): ({'sdc'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Removing single pathed devices sdc {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[843f3b0c-3018-4447-bf5f-5d6005b6cbaf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b377855b-0d68-4fca-b2c0-3a6ebf4f3210]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Flushing IO for device /dev/sdc {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed81037-037c-4729-9b6e-c9c1844f3f02]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[da29e1da-0fd2-4c09-a20e-fdd4df9bb18f]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] SCSI volumes sdc have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d0f1d-642d-4a32-80e6-d31add801759]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9386e5ca-af3a-45bc-a195-850b6b760e28]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32, portal: 172.16.0.220,3260]
Nov 15 14:56:55 user nova-compute[74892]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32, portal: 172.16.0.220,3260] successful.
Nov 15 14:56:55 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4234e8d5-1b24-46a2-9667-cd379e4e0a32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b08b813-740e-463b-99ba-15df89017f8c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] <== disconnect_volume: return (292ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:56:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:56:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:56:56 user nova-compute[74892]: DEBUG nova.objects.instance [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'flavor' on Instance uuid ddac7225-078f-4a64-99ea-7987eb630b4d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:56:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b0f0fe58-579a-4b18-9453-847c91de8465 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.576s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:56:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:57:11 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:57:12 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updating instance_info_cache with network_info: [{"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:57:12 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:57:12 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:57:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:57:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:57:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:57:13 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:57:13 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74892) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:57:14 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:57:15 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:57:15 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.833621978759766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance ddac7225-078f-4a64-99ea-7987eb630b4d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:57:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:57:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:57:20 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:57:25 user nova-compute[74892]: INFO nova.compute.manager [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Terminating instance
Nov 15 14:57:25 user nova-compute[74892]: DEBUG nova.compute.manager [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-7938d6ee-35a4-423e-b88a-7662352b7451 req-ab06a175-fbc7-4f3a-96ea-d2474bc06909 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-changed-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG nova.compute.manager [req-7938d6ee-35a4-423e-b88a-7662352b7451 req-ab06a175-fbc7-4f3a-96ea-d2474bc06909 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Refreshing instance network info cache due to event network-changed-40745894-4292-455a-b5cc-377c6ad3cdac. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7938d6ee-35a4-423e-b88a-7662352b7451 req-ab06a175-fbc7-4f3a-96ea-d2474bc06909 service nova] Acquiring lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7938d6ee-35a4-423e-b88a-7662352b7451 req-ab06a175-fbc7-4f3a-96ea-d2474bc06909 service nova] Acquired lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG nova.network.neutron [req-7938d6ee-35a4-423e-b88a-7662352b7451 req-ab06a175-fbc7-4f3a-96ea-d2474bc06909 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Refreshing network info cache for port 40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-f94127b6-e11e-47d6-b758-b0735b47e148 req-9285bdaa-b6c9-4a64-b62c-e2268b0844d4 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-vif-unplugged-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f94127b6-e11e-47d6-b758-b0735b47e148 req-9285bdaa-b6c9-4a64-b62c-e2268b0844d4 service nova] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f94127b6-e11e-47d6-b758-b0735b47e148 req-9285bdaa-b6c9-4a64-b62c-e2268b0844d4 service nova] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-f94127b6-e11e-47d6-b758-b0735b47e148 req-9285bdaa-b6c9-4a64-b62c-e2268b0844d4 service nova] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-f94127b6-e11e-47d6-b758-b0735b47e148 req-9285bdaa-b6c9-4a64-b62c-e2268b0844d4 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] No waiting events found dispatching network-vif-unplugged-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.compute.manager [req-f94127b6-e11e-47d6-b758-b0735b47e148 req-9285bdaa-b6c9-4a64-b62c-e2268b0844d4 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-vif-unplugged-40745894-4292-455a-b5cc-377c6ad3cdac for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.network.neutron [req-7938d6ee-35a4-423e-b88a-7662352b7451 req-ab06a175-fbc7-4f3a-96ea-d2474bc06909 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updated VIF entry in instance network info cache for port 40745894-4292-455a-b5cc-377c6ad3cdac. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.network.neutron [req-7938d6ee-35a4-423e-b88a-7662352b7451 req-ab06a175-fbc7-4f3a-96ea-d2474bc06909 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updating instance_info_cache with network_info: [{"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-7938d6ee-35a4-423e-b88a-7662352b7451 req-ab06a175-fbc7-4f3a-96ea-d2474bc06909 service nova] Releasing lock "refresh_cache-ddac7225-078f-4a64-99ea-7987eb630b4d" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:57:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Instance destroyed successfully.
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.objects.instance [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'resources' on Instance uuid ddac7225-078f-4a64-99ea-7987eb630b4d {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:54:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-625113073',display_name='tempest-TestStampPattern-server-625113073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-625113073',id=52,image_ref='261921f8-c58f-4e29-b3ca-1eb81aba3291',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPeJ0IXGEcJc61O3mU1/dq8f65qXLLR6+kEyh+NghLrhciWvaUXjA1cbWnVhtXJ0Ufufr1m2LL7P+vg+oA9LDz7J65DDQ6e7gmbZegj/iYeF3EM5sjDlLEJGrRKf+31A==',key_name='tempest-TestStampPattern-983974885',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:54:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39d5cbe17d4c49329687b3b42e8e1d74',ramdisk_id='',reservation_id='r-4uepsqj3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='3b6bb6ef-4936-4598-b95c-cc5f501c2737',image_min_disk='1',image_min_ram='0',image_owner_id='39d5cbe17d4c49329687b3b42e8e1d74',image_owner_project_name='tempest-TestStampPattern-665647939',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-665647939-project-member',image_user_id='e10a3f0b4f784132a7b721651117c7b2',owner_project_name='tempest-TestStampPattern-665647939',owner_user_name='tempest-TestStampPattern-665647939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:54:40Z,user_data=None,user_id='e10a3f0b4f784132a7b721651117c7b2',uuid=ddac7225-078f-4a64-99ea-7987eb630b4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converting VIF {"id": "40745894-4292-455a-b5cc-377c6ad3cdac", "address": "fa:16:3e:54:6e:47", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap40745894-42", "ovs_interfaceid": "40745894-4292-455a-b5cc-377c6ad3cdac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:6e:47,bridge_name='br-int',has_traffic_filtering=True,id=40745894-4292-455a-b5cc-377c6ad3cdac,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40745894-42') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG os_vif [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:6e:47,bridge_name='br-int',has_traffic_filtering=True,id=40745894-4292-455a-b5cc-377c6ad3cdac,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40745894-42') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap40745894-42, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb44c226-b8f4-4a8b-b7d4-1fdbed30e46f) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:26 user nova-compute[74892]: INFO os_vif [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:6e:47,bridge_name='br-int',has_traffic_filtering=True,id=40745894-4292-455a-b5cc-377c6ad3cdac,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap40745894-42')
Nov 15 14:57:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Deleting instance files /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d_del
Nov 15 14:57:26 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Deletion of /opt/stack/data/nova/instances/ddac7225-078f-4a64-99ea-7987eb630b4d_del complete
Nov 15 14:57:26 user nova-compute[74892]: INFO nova.compute.manager [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 14:57:26 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:57:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:27 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:57:27 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Took 0.70 seconds to deallocate network for instance.
Nov 15 14:57:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:57:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:57:27 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:57:27 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:57:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:57:27 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Deleted allocations for instance ddac7225-078f-4a64-99ea-7987eb630b4d
Nov 15 14:57:27 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cd7a75eb-761f-4990-82cb-a8c28b2e76c5 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.912s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:57:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-43f2913a-4565-468f-bf00-86f4d0b3b85b req-a91d36d6-23b8-4875-84c5-d91d60227255 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:57:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43f2913a-4565-468f-bf00-86f4d0b3b85b req-a91d36d6-23b8-4875-84c5-d91d60227255 service nova] Acquiring lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:57:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43f2913a-4565-468f-bf00-86f4d0b3b85b req-a91d36d6-23b8-4875-84c5-d91d60227255 service nova] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:57:28 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-43f2913a-4565-468f-bf00-86f4d0b3b85b req-a91d36d6-23b8-4875-84c5-d91d60227255 service nova] Lock "ddac7225-078f-4a64-99ea-7987eb630b4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:57:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-43f2913a-4565-468f-bf00-86f4d0b3b85b req-a91d36d6-23b8-4875-84c5-d91d60227255 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] No waiting events found dispatching network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:57:28 user nova-compute[74892]: WARNING nova.compute.manager [req-43f2913a-4565-468f-bf00-86f4d0b3b85b req-a91d36d6-23b8-4875-84c5-d91d60227255 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received unexpected event network-vif-plugged-40745894-4292-455a-b5cc-377c6ad3cdac for instance with vm_state deleted and task_state None.
Nov 15 14:57:28 user nova-compute[74892]: DEBUG nova.compute.manager [req-43f2913a-4565-468f-bf00-86f4d0b3b85b req-a91d36d6-23b8-4875-84c5-d91d60227255 service nova] [instance: ddac7225-078f-4a64-99ea-7987eb630b4d] Received event network-vif-deleted-40745894-4292-455a-b5cc-377c6ad3cdac {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:57:31 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:36 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:57:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:57:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:57:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:57:41 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:57:46 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:57:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-5b9409bb-4c8a-484d-9fbc-64dfbb90bf45 req-26468a48-625b-4bd5-af5a-958239d16736 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG nova.compute.manager [req-5b9409bb-4c8a-484d-9fbc-64dfbb90bf45 req-26468a48-625b-4bd5-af5a-958239d16736 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing instance network info cache due to event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5b9409bb-4c8a-484d-9fbc-64dfbb90bf45 req-26468a48-625b-4bd5-af5a-958239d16736 service nova] Acquiring lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5b9409bb-4c8a-484d-9fbc-64dfbb90bf45 req-26468a48-625b-4bd5-af5a-958239d16736 service nova] Acquired lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-5b9409bb-4c8a-484d-9fbc-64dfbb90bf45 req-26468a48-625b-4bd5-af5a-958239d16736 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-5b9409bb-4c8a-484d-9fbc-64dfbb90bf45 req-26468a48-625b-4bd5-af5a-958239d16736 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updated VIF entry in instance network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG nova.network.neutron [req-5b9409bb-4c8a-484d-9fbc-64dfbb90bf45 req-26468a48-625b-4bd5-af5a-958239d16736 service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:58:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5b9409bb-4c8a-484d-9fbc-64dfbb90bf45 req-26468a48-625b-4bd5-af5a-958239d16736 service nova] Releasing lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:58:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:02 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:02 user nova-compute[74892]: INFO nova.compute.manager [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Detaching volume 54a28f1c-1a62-48eb-a62c-345cfa0cbead
Nov 15 14:58:02 user nova-compute[74892]: INFO nova.virt.block_device [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Attempting to driver detach volume 54a28f1c-1a62-48eb-a62c-345cfa0cbead from mountpoint /dev/vdb
Nov 15 14:58:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Attempting to detach device vdb from instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 14:58:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:58:02 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:58:02 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:58:02 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:58:02 user nova-compute[74892]:   <serial>54a28f1c-1a62-48eb-a62c-345cfa0cbead</serial>
Nov 15 14:58:02 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:58:02 user nova-compute[74892]: </disk>
Nov 15 14:58:02 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:58:02 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully detached device vdb from instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 from the persistent domain config.
Nov 15 14:58:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 14:58:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 14:58:02 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 14:58:02 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 14:58:02 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 14:58:02 user nova-compute[74892]:   <serial>54a28f1c-1a62-48eb-a62c-345cfa0cbead</serial>
Nov 15 14:58:02 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 14:58:02 user nova-compute[74892]: </disk>
Nov 15 14:58:02 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 14:58:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:02 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 14:58:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-347fa084-77b7-4d21-bb15-c6c75ef13c76 req-dd717e68-3c6f-4e46-b502-acb225e1bf3c service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:03 user nova-compute[74892]: DEBUG nova.compute.manager [req-347fa084-77b7-4d21-bb15-c6c75ef13c76 req-dd717e68-3c6f-4e46-b502-acb225e1bf3c service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing instance network info cache due to event network-changed-fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:58:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-347fa084-77b7-4d21-bb15-c6c75ef13c76 req-dd717e68-3c6f-4e46-b502-acb225e1bf3c service nova] Acquiring lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:58:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-347fa084-77b7-4d21-bb15-c6c75ef13c76 req-dd717e68-3c6f-4e46-b502-acb225e1bf3c service nova] Acquired lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:58:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-347fa084-77b7-4d21-bb15-c6c75ef13c76 req-dd717e68-3c6f-4e46-b502-acb225e1bf3c service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Refreshing network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:58:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-347fa084-77b7-4d21-bb15-c6c75ef13c76 req-dd717e68-3c6f-4e46-b502-acb225e1bf3c service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updated VIF entry in instance network info cache for port fcde9364-357d-4e72-9e31-435b1ac14519. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:58:03 user nova-compute[74892]: DEBUG nova.network.neutron [req-347fa084-77b7-4d21-bb15-c6c75ef13c76 req-dd717e68-3c6f-4e46-b502-acb225e1bf3c service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [{"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:58:03 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-347fa084-77b7-4d21-bb15-c6c75ef13c76 req-dd717e68-3c6f-4e46-b502-acb225e1bf3c service nova] Releasing lock "refresh_cache-c91c867e-9ddd-48d7-8d7c-b2209f0d6670" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:58:06 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:11 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:13 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:58:13 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 14:58:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:58:13 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:58:13 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 14:58:13 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:58:14 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:58:14 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:58:14 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 14:58:14 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:58:15 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:58:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:58:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8860MB free_disk=24.834102630615234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:17 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:58:17 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 14:58:17 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:58:17 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:58:17 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:58:17 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:58:17 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:58:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-d9c5d9fb-3c36-4070-8f7f-33d6e9c01844 req-05839f92-34bd-4d3f-995c-40399d71e801 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-changed-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-d9c5d9fb-3c36-4070-8f7f-33d6e9c01844 req-05839f92-34bd-4d3f-995c-40399d71e801 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Refreshing instance network info cache due to event network-changed-834d556d-6325-4227-9ceb-9206cc18ae86. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d9c5d9fb-3c36-4070-8f7f-33d6e9c01844 req-05839f92-34bd-4d3f-995c-40399d71e801 service nova] Acquiring lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d9c5d9fb-3c36-4070-8f7f-33d6e9c01844 req-05839f92-34bd-4d3f-995c-40399d71e801 service nova] Acquired lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.network.neutron [req-d9c5d9fb-3c36-4070-8f7f-33d6e9c01844 req-05839f92-34bd-4d3f-995c-40399d71e801 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Refreshing network info cache for port 834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:21 user nova-compute[74892]: INFO nova.compute.manager [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Terminating instance
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.network.neutron [req-d9c5d9fb-3c36-4070-8f7f-33d6e9c01844 req-05839f92-34bd-4d3f-995c-40399d71e801 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updated VIF entry in instance network info cache for port 834d556d-6325-4227-9ceb-9206cc18ae86. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.network.neutron [req-d9c5d9fb-3c36-4070-8f7f-33d6e9c01844 req-05839f92-34bd-4d3f-995c-40399d71e801 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [{"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-c8100877-2b44-4c0e-b6ed-56bcd2845942 req-2f3af765-e6a4-4125-950d-f3ab1cf1ec56 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-vif-unplugged-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8100877-2b44-4c0e-b6ed-56bcd2845942 req-2f3af765-e6a4-4125-950d-f3ab1cf1ec56 service nova] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8100877-2b44-4c0e-b6ed-56bcd2845942 req-2f3af765-e6a4-4125-950d-f3ab1cf1ec56 service nova] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-c8100877-2b44-4c0e-b6ed-56bcd2845942 req-2f3af765-e6a4-4125-950d-f3ab1cf1ec56 service nova] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-c8100877-2b44-4c0e-b6ed-56bcd2845942 req-2f3af765-e6a4-4125-950d-f3ab1cf1ec56 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] No waiting events found dispatching network-vif-unplugged-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG nova.compute.manager [req-c8100877-2b44-4c0e-b6ed-56bcd2845942 req-2f3af765-e6a4-4125-950d-f3ab1cf1ec56 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-vif-unplugged-834d556d-6325-4227-9ceb-9206cc18ae86 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:58:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d9c5d9fb-3c36-4070-8f7f-33d6e9c01844 req-05839f92-34bd-4d3f-995c-40399d71e801 service nova] Releasing lock "refresh_cache-3b6bb6ef-4936-4598-b95c-cc5f501c2737" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 14:58:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Instance destroyed successfully.
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lazy-loading 'resources' on Instance uuid 3b6bb6ef-4936-4598-b95c-cc5f501c2737 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:51:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1338469808',display_name='tempest-TestStampPattern-server-1338469808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1338469808',id=50,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNPeJ0IXGEcJc61O3mU1/dq8f65qXLLR6+kEyh+NghLrhciWvaUXjA1cbWnVhtXJ0Ufufr1m2LL7P+vg+oA9LDz7J65DDQ6e7gmbZegj/iYeF3EM5sjDlLEJGrRKf+31A==',key_name='tempest-TestStampPattern-983974885',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:51:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39d5cbe17d4c49329687b3b42e8e1d74',ramdisk_id='',reservation_id='r-tg67n33k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-665647939',owner_user_name='tempest-TestStampPattern-665647939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:54:32Z,user_data=None,user_id='e10a3f0b4f784132a7b721651117c7b2',uuid=3b6bb6ef-4936-4598-b95c-cc5f501c2737,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converting VIF {"id": "834d556d-6325-4227-9ceb-9206cc18ae86", "address": "fa:16:3e:df:42:c1", "network": {"id": "d5581e75-f961-4515-beae-24c19f3a88db", "bridge": "br-int", "label": "tempest-TestStampPattern-887419809-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39d5cbe17d4c49329687b3b42e8e1d74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap834d556d-63", "ovs_interfaceid": "834d556d-6325-4227-9ceb-9206cc18ae86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:42:c1,bridge_name='br-int',has_traffic_filtering=True,id=834d556d-6325-4227-9ceb-9206cc18ae86,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834d556d-63') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_vif [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:42:c1,bridge_name='br-int',has_traffic_filtering=True,id=834d556d-6325-4227-9ceb-9206cc18ae86,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834d556d-63') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap834d556d-63, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6b59db1-bbc5-494a-9ea4-59c10db34c46) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:22 user nova-compute[74892]: INFO os_vif [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:42:c1,bridge_name='br-int',has_traffic_filtering=True,id=834d556d-6325-4227-9ceb-9206cc18ae86,network=Network(d5581e75-f961-4515-beae-24c19f3a88db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap834d556d-63')
Nov 15 14:58:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Deleting instance files /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737_del
Nov 15 14:58:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Deletion of /opt/stack/data/nova/instances/3b6bb6ef-4936-4598-b95c-cc5f501c2737_del complete
Nov 15 14:58:22 user nova-compute[74892]: INFO nova.compute.manager [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:58:22 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 is timed out.
Nov 15 14:58:22 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully detached device vdb from instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 from the live domain config.
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NkeRjhLM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 14:58:22 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ef381-07a8-4b86-9314-b6fcc70584ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 14:58:22 user nova-compute[74892]: No targets found.
Nov 15 14:58:22 user nova-compute[74892]: iSNS:
Nov 15 14:58:22 user nova-compute[74892]: No targets found.
Nov 15 14:58:22 user nova-compute[74892]: STATIC:
Nov 15 14:58:22 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead
Nov 15 14:58:22 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 14:58:22 user nova-compute[74892]:                 Iface Name: default
Nov 15 14:58:22 user nova-compute[74892]: FIRMWARE:
Nov 15 14:58:22 user nova-compute[74892]: No targets found.
Nov 15 14:58:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 14:58:22 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 14:58:22 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b1e95-b086-4c52-baca-977df530d2a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0f4505-1c69-4091-b171-2bad264ad281]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:58:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead (non-flash)
Nov 15 14:58:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20583640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[623d66c0-e122-44a7-948b-4b65513538f9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[340fe124-d29f-43db-a228-b95ee87e0fa4]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b018d88b-430b-46bd-8029-f817108faabc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[96acb8eb-56f9-48af-bdf2-fef1b90dda23]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55911f6-a804-4024-bbed-b31682bf2917]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Took 0.45 seconds to deallocate network for instance.
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.compute.manager [req-b9b6b32f-3c18-467a-a2d3-0d293fded0b5 req-e9094ac3-f2e0-46e5-8080-6735cbbbb614 service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-vif-deleted-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aac8b5-378f-46ca-a6ba-4686e5eebf06]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead, portal: 172.16.0.220,3260]
Nov 15 14:58:22 user nova-compute[74892]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead, portal: 172.16.0.220,3260] successful.
Nov 15 14:58:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54a28f1c-1a62-48eb-a62c-345cfa0cbead -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[146ce92e-debc-4b91-8934-6fce5abadefe]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] <== disconnect_volume: return (286ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 14:58:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 14:58:23 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:58:23 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:58:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.146s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:23 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Deleted allocations for instance 3b6bb6ef-4936-4598-b95c-cc5f501c2737
Nov 15 14:58:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ff7ead38-384c-4169-9d7d-9d790f7e1142 tempest-TestStampPattern-665647939 tempest-TestStampPattern-665647939-project-member] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.619s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:23 user nova-compute[74892]: DEBUG nova.objects.instance [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'flavor' on Instance uuid c91c867e-9ddd-48d7-8d7c-b2209f0d6670 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:58:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-da31c5d1-5164-4ae1-8837-c91c2efb55a5 tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.641s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-fd90b3df-7e98-455b-b62d-d2a1cdf57acb req-9d2f7259-19b8-48bc-bb11-3b0350af062c service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received event network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fd90b3df-7e98-455b-b62d-d2a1cdf57acb req-9d2f7259-19b8-48bc-bb11-3b0350af062c service nova] Acquiring lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fd90b3df-7e98-455b-b62d-d2a1cdf57acb req-9d2f7259-19b8-48bc-bb11-3b0350af062c service nova] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-fd90b3df-7e98-455b-b62d-d2a1cdf57acb req-9d2f7259-19b8-48bc-bb11-3b0350af062c service nova] Lock "3b6bb6ef-4936-4598-b95c-cc5f501c2737-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:24 user nova-compute[74892]: DEBUG nova.compute.manager [req-fd90b3df-7e98-455b-b62d-d2a1cdf57acb req-9d2f7259-19b8-48bc-bb11-3b0350af062c service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] No waiting events found dispatching network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:58:24 user nova-compute[74892]: WARNING nova.compute.manager [req-fd90b3df-7e98-455b-b62d-d2a1cdf57acb req-9d2f7259-19b8-48bc-bb11-3b0350af062c service nova] [instance: 3b6bb6ef-4936-4598-b95c-cc5f501c2737] Received unexpected event network-vif-plugged-834d556d-6325-4227-9ceb-9206cc18ae86 for instance with vm_state deleted and task_state None.
Nov 15 14:58:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:28 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 14:58:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 14:58:34 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:58:34 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 14:58:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 14:58:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:58:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 14:58:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:54 user nova-compute[74892]: INFO nova.compute.manager [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Terminating instance
Nov 15 14:58:54 user nova-compute[74892]: DEBUG nova.compute.manager [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 14:58:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-1a15473e-7100-40c8-8b9b-2a06ed6dae22 req-96229292-e73b-4736-93f9-57563f2713cb service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-unplugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1a15473e-7100-40c8-8b9b-2a06ed6dae22 req-96229292-e73b-4736-93f9-57563f2713cb service nova] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1a15473e-7100-40c8-8b9b-2a06ed6dae22 req-96229292-e73b-4736-93f9-57563f2713cb service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-1a15473e-7100-40c8-8b9b-2a06ed6dae22 req-96229292-e73b-4736-93f9-57563f2713cb service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-1a15473e-7100-40c8-8b9b-2a06ed6dae22 req-96229292-e73b-4736-93f9-57563f2713cb service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] No waiting events found dispatching network-vif-unplugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.compute.manager [req-1a15473e-7100-40c8-8b9b-2a06ed6dae22 req-96229292-e73b-4736-93f9-57563f2713cb service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-unplugged-fcde9364-357d-4e72-9e31-435b1ac14519 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 14:58:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Instance destroyed successfully.
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lazy-loading 'resources' on Instance uuid c91c867e-9ddd-48d7-8d7c-b2209f0d6670 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T14:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1139138638',display_name='tempest-TestMinimumBasicScenario-server-1139138638',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1139138638',id=51,image_ref='748a5386-1d43-4acb-81c9-cd4ab1ad680a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZTHf4SUpiatHACWDynFnTFnBalg4MSAGvAu9uBbruhqga0lj+cDrFiBFmWPWEY6lE8cVbDJlEl3TZKbz4AGGWY6IbNLSnpjWy8w60opwgF9srJKjq/EsD1KUus3zvlww==',key_name='tempest-TestMinimumBasicScenario-1552781996',keypairs=<?>,launch_index=0,launched_at=2023-11-15T14:54:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e82b93eb8ffe4a2f9ac702406fb1df88',ramdisk_id='',reservation_id='r-flgqnfp6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='748a5386-1d43-4acb-81c9-cd4ab1ad680a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-363938991',owner_user_name='tempest-TestMinimumBasicScenario-363938991-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T14:56:17Z,user_data=None,user_id='bd87bf1610b740e98fbb88b245301c56',uuid=c91c867e-9ddd-48d7-8d7c-b2209f0d6670,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converting VIF {"id": "fcde9364-357d-4e72-9e31-435b1ac14519", "address": "fa:16:3e:cc:f0:ac", "network": {"id": "8ae31762-16e1-4394-9b16-a3ac5f9fca3e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1894368129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82b93eb8ffe4a2f9ac702406fb1df88", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcde9364-35", "ovs_interfaceid": "fcde9364-357d-4e72-9e31-435b1ac14519", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f0:ac,bridge_name='br-int',has_traffic_filtering=True,id=fcde9364-357d-4e72-9e31-435b1ac14519,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcde9364-35') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG os_vif [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f0:ac,bridge_name='br-int',has_traffic_filtering=True,id=fcde9364-357d-4e72-9e31-435b1ac14519,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcde9364-35') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcde9364-35, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8e3a881-4a62-4dab-b3c4-8bf1dd54a998) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:58:55 user nova-compute[74892]: INFO os_vif [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:f0:ac,bridge_name='br-int',has_traffic_filtering=True,id=fcde9364-357d-4e72-9e31-435b1ac14519,network=Network(8ae31762-16e1-4394-9b16-a3ac5f9fca3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcde9364-35')
Nov 15 14:58:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Deleting instance files /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670_del
Nov 15 14:58:55 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Deletion of /opt/stack/data/nova/instances/c91c867e-9ddd-48d7-8d7c-b2209f0d6670_del complete
Nov 15 14:58:55 user nova-compute[74892]: INFO nova.compute.manager [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 14:58:55 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 14:58:55 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 14:58:56 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:58:56 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:58:56 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Took 0.43 seconds to deallocate network for instance.
Nov 15 14:58:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-ad8ad4f9-ca1c-4b8f-820d-b19ba65c3467 req-d349d83f-7ba0-40b4-8012-4ee1452d84bf service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-deleted-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:56 user nova-compute[74892]: INFO nova.compute.manager [req-ad8ad4f9-ca1c-4b8f-820d-b19ba65c3467 req-d349d83f-7ba0-40b4-8012-4ee1452d84bf service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Neutron deleted interface fcde9364-357d-4e72-9e31-435b1ac14519; detaching it from the instance and deleting it from the info cache
Nov 15 14:58:56 user nova-compute[74892]: DEBUG nova.network.neutron [req-ad8ad4f9-ca1c-4b8f-820d-b19ba65c3467 req-d349d83f-7ba0-40b4-8012-4ee1452d84bf service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 14:58:56 user nova-compute[74892]: DEBUG nova.compute.manager [req-ad8ad4f9-ca1c-4b8f-820d-b19ba65c3467 req-d349d83f-7ba0-40b4-8012-4ee1452d84bf service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Detach interface failed, port_id=fcde9364-357d-4e72-9e31-435b1ac14519, reason: Instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670 could not be found. {{(pid=74892) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 14:58:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:56 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:58:56 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:58:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:56 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Deleted allocations for instance c91c867e-9ddd-48d7-8d7c-b2209f0d6670
Nov 15 14:58:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-3212e3f2-6b36-4f80-a904-72cc4c31509b tempest-TestMinimumBasicScenario-363938991 tempest-TestMinimumBasicScenario-363938991-project-member] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.585s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-5eb7ae37-1a4b-4094-8109-81f5ae604bf9 req-3933cb05-6078-411c-8cad-eee661dee56e service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 14:58:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5eb7ae37-1a4b-4094-8109-81f5ae604bf9 req-3933cb05-6078-411c-8cad-eee661dee56e service nova] Acquiring lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:58:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5eb7ae37-1a4b-4094-8109-81f5ae604bf9 req-3933cb05-6078-411c-8cad-eee661dee56e service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:58:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-5eb7ae37-1a4b-4094-8109-81f5ae604bf9 req-3933cb05-6078-411c-8cad-eee661dee56e service nova] Lock "c91c867e-9ddd-48d7-8d7c-b2209f0d6670-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:58:57 user nova-compute[74892]: DEBUG nova.compute.manager [req-5eb7ae37-1a4b-4094-8109-81f5ae604bf9 req-3933cb05-6078-411c-8cad-eee661dee56e service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] No waiting events found dispatching network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 14:58:57 user nova-compute[74892]: WARNING nova.compute.manager [req-5eb7ae37-1a4b-4094-8109-81f5ae604bf9 req-3933cb05-6078-411c-8cad-eee661dee56e service nova] [instance: c91c867e-9ddd-48d7-8d7c-b2209f0d6670] Received unexpected event network-vif-plugged-fcde9364-357d-4e72-9e31-435b1ac14519 for instance with vm_state deleted and task_state None.
Nov 15 14:59:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:59:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:14 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:59:15 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 14:59:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:59:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=24.978504180908203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 14:59:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 14:59:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:20 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:20 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 14:59:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:59:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:59:30 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 14:59:40 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 14:59:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 14:59:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:00:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:00:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:00:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:00:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:00:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:17 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:00:18 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:00:18 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:00:18 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9203MB free_disk=25.009815216064453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:00:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:18 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:00:18 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:00:18 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:00:18 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:00:18 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:00:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:19 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:00:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:00:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:00:25 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:26 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:30 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:00:32 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Starting instance... {{(pid=74892) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:00:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:46 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74892) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:00:46 user nova-compute[74892]: INFO nova.compute.claims [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Claim successful on node user
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Start building networks asynchronously for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Allocating IP information in the background. {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] allocate_for_instance() {{(pid=74892) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:00:47 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Start building block device mappings for instance. {{(pid=74892) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.policy [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9c59ac3d54c49f4b1d18079175e864e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e32502e7314485293b0158e69fee495', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74892) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Start spawning the instance on the hypervisor. {{(pid=74892) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Creating instance directory {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:00:47 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Creating image(s)
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "/opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "/opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.198s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "8e67bbe8102412e57db254306df29a81623dac7e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.206s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk 1073741824 {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e,backing_fmt=raw /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk 1073741824" returned: 0 in 0.082s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "8e67bbe8102412e57db254306df29a81623dac7e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:47 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e67bbe8102412e57db254306df29a81623dac7e --force-share --output=json" returned: 0 in 0.208s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk. size=1073741824 {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG nova.virt.disk.api [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Cannot resize image /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk to a smaller size. {{(pid=74892) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Created local disks {{(pid=74892) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Ensure instance console log exists: /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/console.log {{(pid=74892) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:48 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Successfully created port: 70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Successfully updated port: 70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Building network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-360b0a17-626c-418e-abcb-91da53e0d9fa req-daa28a88-7e1a-48b0-9ee6-a1084ab2e22a service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received event network-changed-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.compute.manager [req-360b0a17-626c-418e-abcb-91da53e0d9fa req-daa28a88-7e1a-48b0-9ee6-a1084ab2e22a service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Refreshing instance network info cache due to event network-changed-70f3d159-1865-4889-ac78-20e4e09caf38. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-360b0a17-626c-418e-abcb-91da53e0d9fa req-daa28a88-7e1a-48b0-9ee6-a1084ab2e22a service nova] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Instance cache missing network info. {{(pid=74892) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.neutron [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Instance network_info: |[{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74892) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-360b0a17-626c-418e-abcb-91da53e0d9fa req-daa28a88-7e1a-48b0-9ee6-a1084ab2e22a service nova] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.neutron [req-360b0a17-626c-418e-abcb-91da53e0d9fa req-daa28a88-7e1a-48b0-9ee6-a1084ab2e22a service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Refreshing network info cache for port 70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Start _get_guest_xml network_info=[{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'image_id': '557dbecf-dbbd-46c7-999f-66066c1bea36'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:00:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:00:49 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] CPU controller missing on host. {{(pid=74892) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.host [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] CPU controller found on host. {{(pid=74892) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74892) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T14:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T14:13:03Z,direct_url=<?>,disk_format='qcow2',id=557dbecf-dbbd-46c7-999f-66066c1bea36,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='11e30cf19ff944f2bcf84ce744b29155',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T14:13:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Flavor limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Image limits 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Flavor pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Image pref 0:0:0 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Got 1 possible topologies {{(pid=74892) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.hardware [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74892) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1493456313',display_name='tempest-SnapshotDataIntegrityTests-server-1493456313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1493456313',id=53,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAIR7g7DWKMS+CQV433bDiQqB7qGL8SoLyl0vd3c7b3zyeyFhs0Xe9ulu3TCpEQ1OPdI4rlnd4W6noW0Mi1U3Af+w0S3Cw4kadCdD8SOqwfHNtRCkyNDU2w0tJ+CNq5yg==',key_name='tempest-keypair-732912768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e32502e7314485293b0158e69fee495',ramdisk_id='',reservation_id='r-g9tgr2qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-672798861',owner_user_name='tempest-SnapshotDataIntegrityTests-672798861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c59ac3d54c49f4b1d18079175e864e',uuid=d8d9811d-8860-4c9d-9439-291cb3f9adb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74892) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Converting VIF {"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c1:10,bridge_name='br-int',has_traffic_filtering=True,id=70f3d159-1865-4889-ac78-20e4e09caf38,network=Network(f52ab434-30cd-4a28-8f31-d46d68455e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f3d159-18') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.objects.instance [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'pci_devices' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:00:49 user nova-compute[74892]:   <uuid>d8d9811d-8860-4c9d-9439-291cb3f9adb8</uuid>
Nov 15 15:00:49 user nova-compute[74892]:   <name>instance-00000035</name>
Nov 15 15:00:49 user nova-compute[74892]:   <memory>524288</memory>
Nov 15 15:00:49 user nova-compute[74892]:   <vcpu>1</vcpu>
Nov 15 15:00:49 user nova-compute[74892]:   <metadata>
Nov 15 15:00:49 user nova-compute[74892]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:00:49 user nova-compute[74892]:       <nova:package version="0.0.0"/>
Nov 15 15:00:49 user nova-compute[74892]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1493456313</nova:name>
Nov 15 15:00:49 user nova-compute[74892]:       <nova:creationTime>2023-11-15 15:00:49</nova:creationTime>
Nov 15 15:00:49 user nova-compute[74892]:       <nova:flavor name="m1.tiny">
Nov 15 15:00:49 user nova-compute[74892]:         <nova:memory>512</nova:memory>
Nov 15 15:00:49 user nova-compute[74892]:         <nova:disk>1</nova:disk>
Nov 15 15:00:49 user nova-compute[74892]:         <nova:swap>0</nova:swap>
Nov 15 15:00:49 user nova-compute[74892]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:00:49 user nova-compute[74892]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:00:49 user nova-compute[74892]:       </nova:flavor>
Nov 15 15:00:49 user nova-compute[74892]:       <nova:owner>
Nov 15 15:00:49 user nova-compute[74892]:         <nova:user uuid="b9c59ac3d54c49f4b1d18079175e864e">tempest-SnapshotDataIntegrityTests-672798861-project-member</nova:user>
Nov 15 15:00:49 user nova-compute[74892]:         <nova:project uuid="2e32502e7314485293b0158e69fee495">tempest-SnapshotDataIntegrityTests-672798861</nova:project>
Nov 15 15:00:49 user nova-compute[74892]:       </nova:owner>
Nov 15 15:00:49 user nova-compute[74892]:       <nova:root type="image" uuid="557dbecf-dbbd-46c7-999f-66066c1bea36"/>
Nov 15 15:00:49 user nova-compute[74892]:       <nova:ports>
Nov 15 15:00:49 user nova-compute[74892]:         <nova:port uuid="70f3d159-1865-4889-ac78-20e4e09caf38">
Nov 15 15:00:49 user nova-compute[74892]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:00:49 user nova-compute[74892]:         </nova:port>
Nov 15 15:00:49 user nova-compute[74892]:       </nova:ports>
Nov 15 15:00:49 user nova-compute[74892]:     </nova:instance>
Nov 15 15:00:49 user nova-compute[74892]:   </metadata>
Nov 15 15:00:49 user nova-compute[74892]:   <sysinfo type="smbios">
Nov 15 15:00:49 user nova-compute[74892]:     <system>
Nov 15 15:00:49 user nova-compute[74892]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:00:49 user nova-compute[74892]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:00:49 user nova-compute[74892]:       <entry name="version">0.0.0</entry>
Nov 15 15:00:49 user nova-compute[74892]:       <entry name="serial">d8d9811d-8860-4c9d-9439-291cb3f9adb8</entry>
Nov 15 15:00:49 user nova-compute[74892]:       <entry name="uuid">d8d9811d-8860-4c9d-9439-291cb3f9adb8</entry>
Nov 15 15:00:49 user nova-compute[74892]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:00:49 user nova-compute[74892]:     </system>
Nov 15 15:00:49 user nova-compute[74892]:   </sysinfo>
Nov 15 15:00:49 user nova-compute[74892]:   <os>
Nov 15 15:00:49 user nova-compute[74892]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:00:49 user nova-compute[74892]:     <boot dev="hd"/>
Nov 15 15:00:49 user nova-compute[74892]:     <smbios mode="sysinfo"/>
Nov 15 15:00:49 user nova-compute[74892]:   </os>
Nov 15 15:00:49 user nova-compute[74892]:   <features>
Nov 15 15:00:49 user nova-compute[74892]:     <acpi/>
Nov 15 15:00:49 user nova-compute[74892]:     <apic/>
Nov 15 15:00:49 user nova-compute[74892]:     <vmcoreinfo/>
Nov 15 15:00:49 user nova-compute[74892]:   </features>
Nov 15 15:00:49 user nova-compute[74892]:   <clock offset="utc">
Nov 15 15:00:49 user nova-compute[74892]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:00:49 user nova-compute[74892]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:00:49 user nova-compute[74892]:     <timer name="hpet" present="no"/>
Nov 15 15:00:49 user nova-compute[74892]:   </clock>
Nov 15 15:00:49 user nova-compute[74892]:   <cpu mode="custom" match="exact">
Nov 15 15:00:49 user nova-compute[74892]:     <model>Nehalem</model>
Nov 15 15:00:49 user nova-compute[74892]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:00:49 user nova-compute[74892]:   </cpu>
Nov 15 15:00:49 user nova-compute[74892]:   <devices>
Nov 15 15:00:49 user nova-compute[74892]:     <disk type="file" device="disk">
Nov 15 15:00:49 user nova-compute[74892]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:00:49 user nova-compute[74892]:       <source file="/opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk"/>
Nov 15 15:00:49 user nova-compute[74892]:       <target dev="vda" bus="virtio"/>
Nov 15 15:00:49 user nova-compute[74892]:     </disk>
Nov 15 15:00:49 user nova-compute[74892]:     <interface type="ethernet">
Nov 15 15:00:49 user nova-compute[74892]:       <mac address="fa:16:3e:76:c1:10"/>
Nov 15 15:00:49 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 15:00:49 user nova-compute[74892]:       <mtu size="1442"/>
Nov 15 15:00:49 user nova-compute[74892]:       <target dev="tap70f3d159-18"/>
Nov 15 15:00:49 user nova-compute[74892]:     </interface>
Nov 15 15:00:49 user nova-compute[74892]:     <serial type="pty">
Nov 15 15:00:49 user nova-compute[74892]:       <log file="/opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/console.log" append="off"/>
Nov 15 15:00:49 user nova-compute[74892]:     </serial>
Nov 15 15:00:49 user nova-compute[74892]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:00:49 user nova-compute[74892]:     <video>
Nov 15 15:00:49 user nova-compute[74892]:       <model type="virtio"/>
Nov 15 15:00:49 user nova-compute[74892]:     </video>
Nov 15 15:00:49 user nova-compute[74892]:     <rng model="virtio">
Nov 15 15:00:49 user nova-compute[74892]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:00:49 user nova-compute[74892]:     </rng>
Nov 15 15:00:49 user nova-compute[74892]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:00:49 user nova-compute[74892]:     <memballoon model="virtio">
Nov 15 15:00:49 user nova-compute[74892]:       <stats period="10"/>
Nov 15 15:00:49 user nova-compute[74892]:     </memballoon>
Nov 15 15:00:49 user nova-compute[74892]:   </devices>
Nov 15 15:00:49 user nova-compute[74892]: </domain>
Nov 15 15:00:49 user nova-compute[74892]:  {{(pid=74892) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1493456313',display_name='tempest-SnapshotDataIntegrityTests-server-1493456313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1493456313',id=53,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAIR7g7DWKMS+CQV433bDiQqB7qGL8SoLyl0vd3c7b3zyeyFhs0Xe9ulu3TCpEQ1OPdI4rlnd4W6noW0Mi1U3Af+w0S3Cw4kadCdD8SOqwfHNtRCkyNDU2w0tJ+CNq5yg==',key_name='tempest-keypair-732912768',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e32502e7314485293b0158e69fee495',ramdisk_id='',reservation_id='r-g9tgr2qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-672798861',owner_user_name='tempest-SnapshotDataIntegrityTests-672798861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c59ac3d54c49f4b1d18079175e864e',uuid=d8d9811d-8860-4c9d-9439-291cb3f9adb8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Converting VIF {"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:c1:10,bridge_name='br-int',has_traffic_filtering=True,id=70f3d159-1865-4889-ac78-20e4e09caf38,network=Network(f52ab434-30cd-4a28-8f31-d46d68455e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f3d159-18') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG os_vif [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c1:10,bridge_name='br-int',has_traffic_filtering=True,id=70f3d159-1865-4889-ac78-20e4e09caf38,network=Network(f52ab434-30cd-4a28-8f31-d46d68455e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f3d159-18') {{(pid=74892) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8c7f6e6-06fe-58d7-9489-aa772dcbc5ad', '_type': 'linux-noop'}}, row=False) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70f3d159-18, may_exist=True, interface_attrs={}) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70f3d159-18, col_values=(('qos', UUID('79370256-8674-48e1-af28-797e492806b7')),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70f3d159-18, col_values=(('external_ids', {'iface-id': '70f3d159-1865-4889-ac78-20e4e09caf38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:c1:10', 'vm-uuid': 'd8d9811d-8860-4c9d-9439-291cb3f9adb8'}),), if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:49 user nova-compute[74892]: INFO os_vif [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:c1:10,bridge_name='br-int',has_traffic_filtering=True,id=70f3d159-1865-4889-ac78-20e4e09caf38,network=Network(f52ab434-30cd-4a28-8f31-d46d68455e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f3d159-18')
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:00:49 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No VIF found with MAC fa:16:3e:76:c1:10, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:00:50 user nova-compute[74892]: DEBUG nova.network.neutron [req-360b0a17-626c-418e-abcb-91da53e0d9fa req-daa28a88-7e1a-48b0-9ee6-a1084ab2e22a service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updated VIF entry in instance network info cache for port 70f3d159-1865-4889-ac78-20e4e09caf38. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:00:50 user nova-compute[74892]: DEBUG nova.network.neutron [req-360b0a17-626c-418e-abcb-91da53e0d9fa req-daa28a88-7e1a-48b0-9ee6-a1084ab2e22a service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:00:50 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-360b0a17-626c-418e-abcb-91da53e0d9fa req-daa28a88-7e1a-48b0-9ee6-a1084ab2e22a service nova] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:00:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-61164ed4-5974-499b-9e59-5d7363017427 req-d3919d67-90c8-49ea-b77d-48a18d33dd5d service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received event network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:00:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-61164ed4-5974-499b-9e59-5d7363017427 req-d3919d67-90c8-49ea-b77d-48a18d33dd5d service nova] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-61164ed4-5974-499b-9e59-5d7363017427 req-d3919d67-90c8-49ea-b77d-48a18d33dd5d service nova] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-61164ed4-5974-499b-9e59-5d7363017427 req-d3919d67-90c8-49ea-b77d-48a18d33dd5d service nova] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:51 user nova-compute[74892]: DEBUG nova.compute.manager [req-61164ed4-5974-499b-9e59-5d7363017427 req-d3919d67-90c8-49ea-b77d-48a18d33dd5d service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] No waiting events found dispatching network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:00:51 user nova-compute[74892]: WARNING nova.compute.manager [req-61164ed4-5974-499b-9e59-5d7363017427 req-d3919d67-90c8-49ea-b77d-48a18d33dd5d service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received unexpected event network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 for instance with vm_state building and task_state spawning.
Nov 15 15:00:51 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-36fb08b9-6d2f-443e-8870-38803c6413fa req-283b21b1-a4b8-41bf-9e99-5df8287dc155 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received event network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36fb08b9-6d2f-443e-8870-38803c6413fa req-283b21b1-a4b8-41bf-9e99-5df8287dc155 service nova] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36fb08b9-6d2f-443e-8870-38803c6413fa req-283b21b1-a4b8-41bf-9e99-5df8287dc155 service nova] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-36fb08b9-6d2f-443e-8870-38803c6413fa req-283b21b1-a4b8-41bf-9e99-5df8287dc155 service nova] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.compute.manager [req-36fb08b9-6d2f-443e-8870-38803c6413fa req-283b21b1-a4b8-41bf-9e99-5df8287dc155 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] No waiting events found dispatching network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:00:53 user nova-compute[74892]: WARNING nova.compute.manager [req-36fb08b9-6d2f-443e-8870-38803c6413fa req-283b21b1-a4b8-41bf-9e99-5df8287dc155 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received unexpected event network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 for instance with vm_state building and task_state spawning.
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Instance event wait completed in 0 seconds for  {{(pid=74892) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Guest created on hypervisor {{(pid=74892) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:00:53 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Instance spawned successfully.
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Found default for hw_cdrom_bus of ide {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Found default for hw_disk_bus of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Found default for hw_input_bus of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Found default for hw_pointer_model of None {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Found default for hw_video_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Found default for hw_vif_model of virtio {{(pid=74892) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:00:53 user nova-compute[74892]: INFO nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 15 15:00:53 user nova-compute[74892]: DEBUG nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Checking state {{(pid=74892) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:00:53 user nova-compute[74892]: INFO nova.compute.manager [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Took 7.12 seconds to build instance.
Nov 15 15:00:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7dd89922-ae84-4acb-acea-57496010663e tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.299s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:00:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:00:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:01:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:01:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:01:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:01:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:01:16 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:01:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:01:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:01:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:01:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:17 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:01:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:01:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:01:18 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:01:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:01:19 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:01:19 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:01:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=24.972091674804688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:01:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:22 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:01:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:27 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:27 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:31 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:44 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:01:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:01:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:01:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:01:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:01:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:01:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:01:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:02:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:02:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:02:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:16 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:02:16 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:02:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:02:16 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:02:16 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:02:16 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:02:17 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:02:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:02:17 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:02:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:02:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:02:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:02:18 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:02:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:19 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:02:19 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:02:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=24.9713134765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:02:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:02:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:27 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:02:32 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:02:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:37 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-d0d7d938-c4ec-4f03-99fc-816212b8bf8b req-3a2382e5-8216-4bc2-a0b8-c4587ced9a44 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received event network-changed-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:02:37 user nova-compute[74892]: DEBUG nova.compute.manager [req-d0d7d938-c4ec-4f03-99fc-816212b8bf8b req-3a2382e5-8216-4bc2-a0b8-c4587ced9a44 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Refreshing instance network info cache due to event network-changed-70f3d159-1865-4889-ac78-20e4e09caf38. {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:02:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0d7d938-c4ec-4f03-99fc-816212b8bf8b req-3a2382e5-8216-4bc2-a0b8-c4587ced9a44 service nova] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:02:37 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0d7d938-c4ec-4f03-99fc-816212b8bf8b req-3a2382e5-8216-4bc2-a0b8-c4587ced9a44 service nova] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:02:37 user nova-compute[74892]: DEBUG nova.network.neutron [req-d0d7d938-c4ec-4f03-99fc-816212b8bf8b req-3a2382e5-8216-4bc2-a0b8-c4587ced9a44 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Refreshing network info cache for port 70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:02:38 user nova-compute[74892]: DEBUG nova.network.neutron [req-d0d7d938-c4ec-4f03-99fc-816212b8bf8b req-3a2382e5-8216-4bc2-a0b8-c4587ced9a44 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updated VIF entry in instance network info cache for port 70f3d159-1865-4889-ac78-20e4e09caf38. {{(pid=74892) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:02:38 user nova-compute[74892]: DEBUG nova.network.neutron [req-d0d7d938-c4ec-4f03-99fc-816212b8bf8b req-3a2382e5-8216-4bc2-a0b8-c4587ced9a44 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:02:38 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d0d7d938-c4ec-4f03-99fc-816212b8bf8b req-3a2382e5-8216-4bc2-a0b8-c4587ced9a44 service nova] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:02:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG nova.objects.instance [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:02:40 user nova-compute[74892]: INFO nova.compute.manager [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attaching volume 077688be-fec2-4fe6-8b6c-82f3d4d33023 to /dev/vdb
Nov 15 15:02:40 user nova-compute[74892]: DEBUG os_brick.utils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8909bf36-8806-4def-9521-ffcab90b082f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40ecbf1-4eff-4164-919d-b51f53f54152]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[49429623-c60d-47ea-89de-4be07b86e7f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce4cb0e-7232-464c-9458-bc594ae0758d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:02:40 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:02:40 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fd414d-c609-4d71-b490-3b64faf05521]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG os_brick.utils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:02:40 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating existing volume attachment record: 50005406-020f-4f27-b7e8-1500e4681f9a {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:02:42 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYaqEPwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:02:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:02:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:02:44 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a20a21b-98c8-4d59-afff-76c973a22954]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:02:44 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d32ac9-33a1-40c4-91db-14dee70bca06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023] added
Nov 15 15:02:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b4cfee-c2d6-438d-acba-db32190dd2f3]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4261bc-9bec-44af-8e1b-0016b2314820]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYaqEPwS {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gYaqEPwS" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4614f7-52f4-40b4-a723-311eabf450ee]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gYaqEPwS'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc859861-d9a8-40a8-b3f1-a036e675a625]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[326bd1b3-869f-4060-a50e-6bbc393b1c0c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:02:44 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:02:44 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:02:44 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 15:02:44 user nova-compute[74892]: 
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de6a550-81ab-4920-bc36-9236ff63ee4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023, portal: 172.16.0.220,3260]
Nov 15 15:02:44 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023, portal: 172.16.0.220,3260] successful.
Nov 15 15:02:44 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:02:44 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09810d4-33fd-433b-b0c7-a01f714c4808]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19a330b-7a0f-48da-9ee6-df391099ba65]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 (non-flash)
Nov 15 15:02:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 (non-flash)
Nov 15 15:02:45 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11bd7d9-5fa0-428d-abad-14ba81b82405]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:02:45 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYaqEPwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23435303638373637', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435303638373637', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG nova.objects.instance [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:02:46 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:02:46 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:02:46 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:02:46 user nova-compute[74892]:   <serial>077688be-fec2-4fe6-8b6c-82f3d4d33023</serial>
Nov 15 15:02:46 user nova-compute[74892]: </disk>
Nov 15 15:02:46 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No VIF found with MAC fa:16:3e:76:c1:10, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:02:46 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-b247f3bc-6f8e-4750-8dff-fc5e78ea19ba tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.419s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:02:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:02:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:02:56 user nova-compute[74892]: INFO nova.compute.manager [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Detaching volume 077688be-fec2-4fe6-8b6c-82f3d4d33023
Nov 15 15:02:56 user nova-compute[74892]: INFO nova.virt.block_device [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attempting to driver detach volume 077688be-fec2-4fe6-8b6c-82f3d4d33023 from mountpoint /dev/vdb
Nov 15 15:02:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Attempting to detach device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:02:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:02:56 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:02:56 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:02:56 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:02:56 user nova-compute[74892]:   <serial>077688be-fec2-4fe6-8b6c-82f3d4d33023</serial>
Nov 15 15:02:56 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:02:56 user nova-compute[74892]: </disk>
Nov 15 15:02:56 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:02:56 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully detached device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the persistent domain config.
Nov 15 15:02:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:02:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:02:56 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:02:56 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:02:56 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:02:56 user nova-compute[74892]:   <serial>077688be-fec2-4fe6-8b6c-82f3d4d33023</serial>
Nov 15 15:02:56 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:02:56 user nova-compute[74892]: </disk>
Nov 15 15:02:56 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:02:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:02:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:02:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:03:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:03:12 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:16 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 is timed out.
Nov 15 15:03:16 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully detached device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the live domain config.
Nov 15 15:03:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gYaqEPwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:03:16 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[876e7bb9-8597-41bc-8cc8-0874b4f0f49b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:03:16 user nova-compute[74892]: No targets found.
Nov 15 15:03:16 user nova-compute[74892]: iSNS:
Nov 15 15:03:16 user nova-compute[74892]: No targets found.
Nov 15 15:03:16 user nova-compute[74892]: STATIC:
Nov 15 15:03:16 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023
Nov 15 15:03:16 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:03:16 user nova-compute[74892]:                 Iface Name: default
Nov 15 15:03:16 user nova-compute[74892]: FIRMWARE:
Nov 15 15:03:16 user nova-compute[74892]: No targets found.
Nov 15 15:03:16 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:03:16 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:03:16 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dbf5e7-c2d7-4f1f-b3d3-8674d62fa196]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fedda6b-9c45-47f6-a0c3-7abef664015c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 (non-flash)
Nov 15 15:03:16 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 (non-flash)
Nov 15 15:03:16 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd004b1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b8df4e-2347-4d5e-8044-5022232b2efd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e8209c-cc8e-494e-8784-5074aa227484]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1307969b-d221-4be0-946d-52b7bd4908d3]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[533e90a9-d306-4690-a795-28c3521e3355]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14962fd-939d-4d43-9719-904c487f2049]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[246186be-d5b7-4e57-972c-708775f1a590]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023, portal: 172.16.0.220,3260]
Nov 15 15:03:16 user nova-compute[74892]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023, portal: 172.16.0.220,3260] successful.
Nov 15 15:03:16 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:077688be-fec2-4fe6-8b6c-82f3d4d33023 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ab76c8-aa22-4e60-a7ab-72dd78545a7b]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== disconnect_volume: return (283ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:03:16 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:03:17 user nova-compute[74892]: DEBUG nova.objects.instance [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:03:17 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-2a06bd46-360c-47b9-9fb9-138845ac32bc tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.592s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:03:17 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:03:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:03:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:03:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:03:18 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:03:18 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:03:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:03:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:03:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:03:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:03:20 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:20 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:03:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:03:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:03:20 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:03:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:03:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:03:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=24.970069885253906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:03:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:03:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:03:25 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:25 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:03:29 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:03:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:03:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:03:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:03:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:32 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:33 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:03:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:03:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:03:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:03:34 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:39 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:42 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:42 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74892) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 15:03:44 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:46 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Cleaning up deleted instances {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 15:03:46 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] There are 0 instances to clean {{(pid=74892) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 15:03:47 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:03:48 user nova-compute[74892]: INFO nova.compute.manager [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attaching volume b2429be6-5cb4-41db-b79f-64577a5ffee5 to /dev/vdb
Nov 15 15:03:48 user nova-compute[74892]: DEBUG os_brick.utils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c66de52-2fe4-49b1-828a-e9be31c771ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0933d53-bc26-4cbe-92e5-67ba6596d8cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b994ee-a732-46cb-aad9-ab8700a3a15b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3475872a-f928-4fde-bd30-3f2493faa0eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:03:48 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9897e2-2851-45d7-b8dc-f57885aa15da]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG os_brick.utils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating existing volume attachment record: da65e2ae-c773-4267-a5ae-7dcfb931e964 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:03:48 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:03:49 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFWMdVyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:03:52 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:03:52 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:03:52 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6c1b6b-966e-4ed2-8529-e0269f2c0ab2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:03:52 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd1f1a3-a407-42f4-aaf5-2fe29a01d72e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5] added
Nov 15 15:03:52 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[38251a8f-03f6-4ac8-beb3-7a6e1ed603fe]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2097b5e5-f5d7-4882-8de0-a3c5457c5e0f]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFWMdVyc {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nFWMdVyc" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:52 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c63d02-85da-405e-9f28-33b0fd7fdd52]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nFWMdVyc'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5c846c-11ae-4f62-9259-b476409b4e99]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e64dd82-d6a0-4d47-be55-e7fcd237d93f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:03:53 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:03:53 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:03:53 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 15:03:53 user nova-compute[74892]: 
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f333ef52-e29e-4db9-b905-697114864cd7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5, portal: 172.16.0.220,3260]
Nov 15 15:03:53 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5, portal: 172.16.0.220,3260] successful.
Nov 15 15:03:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[b152e166-1e67-4613-be5e-6b2c91a30f0e]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[156b0d5f-9047-4b35-a303-39e5f1c13dd3]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 (non-flash)
Nov 15 15:03:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 (non-flash)
Nov 15 15:03:53 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4f255c-0234-40e2-865b-e65f05cc1eda]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:03:53 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFWMdVyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23033663232356531', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033663232356531', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:03:54 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:03:54 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:03:54 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:03:54 user nova-compute[74892]:   <serial>b2429be6-5cb4-41db-b79f-64577a5ffee5</serial>
Nov 15 15:03:54 user nova-compute[74892]: </disk>
Nov 15 15:03:54 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No VIF found with MAC fa:16:3e:76:c1:10, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a8eebb73-6361-463f-9eca-1efd376dc37f tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.512s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:03:54 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:03:57 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:03:57 user nova-compute[74892]: INFO nova.compute.manager [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Detaching volume b2429be6-5cb4-41db-b79f-64577a5ffee5
Nov 15 15:03:57 user nova-compute[74892]: INFO nova.virt.block_device [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attempting to driver detach volume b2429be6-5cb4-41db-b79f-64577a5ffee5 from mountpoint /dev/vdb
Nov 15 15:03:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Attempting to detach device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:03:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:03:57 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:03:57 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:03:57 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:03:57 user nova-compute[74892]:   <serial>b2429be6-5cb4-41db-b79f-64577a5ffee5</serial>
Nov 15 15:03:57 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:03:57 user nova-compute[74892]: </disk>
Nov 15 15:03:57 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:03:57 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully detached device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the persistent domain config.
Nov 15 15:03:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:03:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:03:57 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:03:57 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:03:57 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:03:57 user nova-compute[74892]:   <serial>b2429be6-5cb4-41db-b79f-64577a5ffee5</serial>
Nov 15 15:03:57 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:03:57 user nova-compute[74892]: </disk>
Nov 15 15:03:57 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:03:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:03:57 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:03:59 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:09 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:14 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:17 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 is timed out.
Nov 15 15:04:17 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully detached device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the live domain config.
Nov 15 15:04:17 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:04:17 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nFWMdVyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:04:17 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:04:17 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:04:17 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6680b61f-5de6-4461-8419-bc181147e5ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:04:18 user nova-compute[74892]: No targets found.
Nov 15 15:04:18 user nova-compute[74892]: iSNS:
Nov 15 15:04:18 user nova-compute[74892]: No targets found.
Nov 15 15:04:18 user nova-compute[74892]: STATIC:
Nov 15 15:04:18 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5
Nov 15 15:04:18 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:04:18 user nova-compute[74892]:                 Iface Name: default
Nov 15 15:04:18 user nova-compute[74892]: FIRMWARE:
Nov 15 15:04:18 user nova-compute[74892]: No targets found.
Nov 15 15:04:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:04:18 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:04:18 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d1e230-73bf-49cd-a963-bf6df47859c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4d8bdd-40ba-4495-9735-583374844e78]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 (non-flash)
Nov 15 15:04:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 (non-flash)
Nov 15 15:04:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd004b3b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a57ec6-0a6b-4e34-bd2e-824f467a271f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[458fc3de-4303-4bb7-ae5e-35c2d232c63b]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c0e0fc-068f-49c3-990d-f102793fe1cc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c1241c-23ce-447f-8725-e80cff326607]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef2b5c-83fb-432e-a7b5-4f781f784f57]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[11669a16-ec53-4b41-be75-6e79f3263017]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5, portal: 172.16.0.220,3260]
Nov 15 15:04:18 user nova-compute[74892]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5, portal: 172.16.0.220,3260] successful.
Nov 15 15:04:18 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2429be6-5cb4-41db-b79f-64577a5ffee5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[110e4613-ed09-4eb8-8a2d-7c7d425439cc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== disconnect_volume: return (303ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:04:18 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG nova.objects.instance [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-402e1ba0-dcf8-47ec-b8e1-54ef1921571d tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.692s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:04:19 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:20 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:04:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:04:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:04:20 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:04:20 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:04:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=24.969085693359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing inventories for resource provider f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating ProviderTree inventory for provider f0684847-d6be-43f9-9eb9-f058843467dc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Updating inventory in ProviderTree for provider f0684847-d6be-43f9-9eb9-f058843467dc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing aggregate associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, aggregates: None {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Refreshing trait associations for resource provider f0684847-d6be-43f9-9eb9-f058843467dc, traits: COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=74892) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:04:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:04:22 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:24 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:24 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:04:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:26 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Triggering sync for uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:04:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:04:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:04:26 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:04:27 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:27 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:04:29 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:04:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:04:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:04:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:04:29 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:35 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:04:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:04:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:04:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:04:49 user nova-compute[74892]: DEBUG nova.objects.instance [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:04:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:04:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:04:49 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:04:49 user nova-compute[74892]: INFO nova.compute.manager [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attaching volume 492826bd-44c5-4298-b134-5901857760c4 to /dev/vdb
Nov 15 15:04:49 user nova-compute[74892]: DEBUG os_brick.utils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:04:49 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4086675-ce2d-45f1-85f1-672069e2117c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fbfff8-4809-4c81-bcbf-579d2642ca63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c39415-0a3a-4bb1-81f6-fc934314bf8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de244ed-d38d-4181-b2cf-9fce45582f4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:04:50 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:04:50 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d146cd-7811-4881-b82b-716e4967528a]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG os_brick.utils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:04:50 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating existing volume attachment record: 154ae627-88a2-4bb5-9857-52ee6cb51acf {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:04:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKhoHRtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:04:54 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:04:54 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:04:54 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[630aad8f-1201-43d0-a5ab-9d13e9dbc867]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:04:54 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[318c5364-1c52-4e69-9e1f-db5fbedebcd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4] added
Nov 15 15:04:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36805d6-8635-45d1-8541-a989889448c2]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce472462-03dc-4ba0-ab6e-a95b4546c6b7]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKhoHRtx {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKhoHRtx" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49a0acf-e813-4c25-979a-9b3ee6ff8952]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKhoHRtx'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ecdf0e-52c9-4eec-b4ce-564ad3a1840c]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d5ec3e-1bd2-4c2d-89e3-aec82b7d1898]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:04:54 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:04:54 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:04:54 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 15:04:54 user nova-compute[74892]: 
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83aa1f9-34d7-46e8-8b02-3ecc5d0dad2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4, portal: 172.16.0.220,3260]
Nov 15 15:04:54 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4, portal: 172.16.0.220,3260] successful.
Nov 15 15:04:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ec4755-c900-4753-9a35-0749078a5073]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f68be1d-7f85-42f5-a352-7f6124b0c422]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 (non-flash)
Nov 15 15:04:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 (non-flash)
Nov 15 15:04:54 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e368d4-6dd8-4bfa-a4c8-0c07922c9ec6]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:04:54 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKhoHRtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:04:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:04:55 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23036653866666465', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:04:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036653866666465', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:04:55 user nova-compute[74892]: DEBUG nova.objects.instance [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:04:55 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:04:55 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:04:55 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:04:55 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:04:55 user nova-compute[74892]:   <serial>492826bd-44c5-4298-b134-5901857760c4</serial>
Nov 15 15:04:55 user nova-compute[74892]: </disk>
Nov 15 15:04:55 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:04:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:04:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:04:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No VIF found with MAC fa:16:3e:76:c1:10, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:04:56 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-cea1dcb2-82ab-4a8e-9cc4-85f3ea247e08 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.493s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:04:57 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:04:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:04:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:04:58 user nova-compute[74892]: INFO nova.compute.manager [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Detaching volume 492826bd-44c5-4298-b134-5901857760c4
Nov 15 15:04:58 user nova-compute[74892]: INFO nova.virt.block_device [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attempting to driver detach volume 492826bd-44c5-4298-b134-5901857760c4 from mountpoint /dev/vdb
Nov 15 15:04:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Attempting to detach device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:04:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:04:59 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:04:59 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:04:59 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:04:59 user nova-compute[74892]:   <serial>492826bd-44c5-4298-b134-5901857760c4</serial>
Nov 15 15:04:59 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:04:59 user nova-compute[74892]: </disk>
Nov 15 15:04:59 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:04:59 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully detached device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the persistent domain config.
Nov 15 15:04:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:04:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:04:59 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:04:59 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:04:59 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:04:59 user nova-compute[74892]:   <serial>492826bd-44c5-4298-b134-5901857760c4</serial>
Nov 15 15:04:59 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:04:59 user nova-compute[74892]: </disk>
Nov 15 15:04:59 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:04:59 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:05:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:19 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 is timed out.
Nov 15 15:05:19 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully detached device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the live domain config.
Nov 15 15:05:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKhoHRtx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:05:19 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88a4c38-1157-4e06-ace7-00cc7c4fa7ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:05:19 user nova-compute[74892]: No targets found.
Nov 15 15:05:19 user nova-compute[74892]: iSNS:
Nov 15 15:05:19 user nova-compute[74892]: No targets found.
Nov 15 15:05:19 user nova-compute[74892]: STATIC:
Nov 15 15:05:19 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4
Nov 15 15:05:19 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:05:19 user nova-compute[74892]:                 Iface Name: default
Nov 15 15:05:19 user nova-compute[74892]: FIRMWARE:
Nov 15 15:05:19 user nova-compute[74892]: No targets found.
Nov 15 15:05:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:05:19 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:05:19 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18017eb-bf25-4fad-aa08-44f6b0ad4bde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5cd12c-85ff-430c-a1db-da2ddba58ac5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 (non-flash)
Nov 15 15:05:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 (non-flash)
Nov 15 15:05:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd4031ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b85f760-e2a6-4746-aa9b-3a7d4823ef07]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e6a83-1fde-4e67-9408-5230f87f85f6]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1627953d-0b8d-47ec-9daf-935e0ee90dda]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[714dccb9-f75d-407a-b2af-d0e71aa12833]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ca187f-23bc-486d-a4c3-fab440468907]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca57f5f-d156-4358-8cbc-b247149064be]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4, portal: 172.16.0.220,3260]
Nov 15 15:05:19 user nova-compute[74892]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4, portal: 172.16.0.220,3260] successful.
Nov 15 15:05:19 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:492826bd-44c5-4298-b134-5901857760c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[21703ee6-51fc-44f4-a20b-405e4606d499]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== disconnect_volume: return (307ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:05:19 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG nova.objects.instance [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:05:20 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-7396efe2-0a71-45d5-b8e4-f6d45ddc13e5 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.852s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:05:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:05:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:05:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:05:21 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:05:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:22 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:05:22 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:05:22 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9005MB free_disk=24.968093872070312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:05:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:05:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:05:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:28 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:05:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:05:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:05:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:05:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:05:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:30 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:37 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:05:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:05:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:05:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:05:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:05:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:05:51 user nova-compute[74892]: INFO nova.compute.manager [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attaching volume b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e to /dev/vdb
Nov 15 15:05:51 user nova-compute[74892]: DEBUG os_brick.utils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a25b36-e8b0-444b-a733-b16a9916d65c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:4611276bbc3\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b50b2-6790-4ed4-b6e3-4105051b37e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd59040-a8be-402c-bd3b-29772a40edce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ba7ed1-ffbe-4a34-9d63-4a0887315c3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Running cmd (subprocess): nvme version {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] 'nvme version' failed. Not Retrying. {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] nvme not present on system {{(pid=74892) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:05:51 user nova-compute[74892]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:05:51 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1892db69-1c5d-458f-abe5-56027d7ff395]: (4, '') {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74892) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.lightos [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] LIGHTOS: no hostnqn found. {{(pid=74892) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG os_brick.utils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:4611276bbc3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:05:51 user nova-compute[74892]: DEBUG nova.virt.block_device [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating existing volume attachment record: 66fa9312-bc96-4a56-be58-c65a494b7861 {{(pid=74892) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:05:52 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Calling os-brick to attach iSCSI Volume {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbRqeVyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:05:56 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:05:56 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:05:56 user nova-compute[74892]: INFO os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf02fc1-6b5e-4e91-bb68-be7138037e66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:05:56 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --interface default --op new {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5e6400-6efa-4b08-b047-ecc8a9100942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e] added\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e] added
Nov 15 15:05:56 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd64008-a674-4cd8-865c-b8a5d641b257]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[876972a8-de31-4865-b1db-68015bae1ea0]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbRqeVyh {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbRqeVyh" returned: 0 in 0.025s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b07410d-3239-46e6-b2d9-031a403f8a45]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HbRqeVyh'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:56 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[13982072-201d-4fab-8360-d79fa2227b51]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c54bedb-65cc-4a09-95a4-1f04833a96ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:05:57 user nova-compute[74892]:  {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:05:57 user nova-compute[74892]:  {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:05:57 user nova-compute[74892]: WARNING os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 15:05:57 user nova-compute[74892]: 
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --login {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf8d47-9279-478b-996b-332dfc0466a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e, portal: 172.16.0.220,3260]
Nov 15 15:05:57 user nova-compute[74892]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e, portal: 172.16.0.220,3260] successful.
Nov 15 15:05:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc966ae-49a4-4528-9db0-7c53e99a63bf]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd87c80-38be-4b38-8218-96763d28f5ac]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e (non-flash)
Nov 15 15:05:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e (non-flash)
Nov 15 15:05:57 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Connected to 172.16.0.220:3260 {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74892) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74892) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e269e5-c56b-4abf-bdaa-8c8a2dd24b28]: (4, ('- - 0', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:05:57 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74892) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbRqeVyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74892) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26530376363326534', 'path': '/dev/sdb'} {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530376363326534', 'path': '/dev/sdb'} {{(pid=74892) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG nova.objects.instance [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:05:58 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:05:58 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:05:58 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:05:58 user nova-compute[74892]:   <serial>b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e</serial>
Nov 15 15:05:58 user nova-compute[74892]: </disk>
Nov 15 15:05:58 user nova-compute[74892]:  {{(pid=74892) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vda, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74892) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] No VIF found with MAC fa:16:3e:76:c1:10, not building metadata {{(pid=74892) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:05:58 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-a25e1374-82ad-4345-8f26-81366a0c31b0 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.507s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:06:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:06:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:06:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:06:01 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:06:01 user nova-compute[74892]: INFO nova.compute.manager [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Detaching volume b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e
Nov 15 15:06:01 user nova-compute[74892]: INFO nova.virt.block_device [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Attempting to driver detach volume b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e from mountpoint /dev/vdb
Nov 15 15:06:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Attempting to detach device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the persistent domain config. {{(pid=74892) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:06:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:06:01 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:06:01 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:06:01 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:06:01 user nova-compute[74892]:   <serial>b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e</serial>
Nov 15 15:06:01 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:06:01 user nova-compute[74892]: </disk>
Nov 15 15:06:01 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:06:01 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully detached device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the persistent domain config.
Nov 15 15:06:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the live domain config. {{(pid=74892) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:06:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.guest [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:06:01 user nova-compute[74892]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:06:01 user nova-compute[74892]:   <source dev="/dev/sdb"/>
Nov 15 15:06:01 user nova-compute[74892]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:06:01 user nova-compute[74892]:   <serial>b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e</serial>
Nov 15 15:06:01 user nova-compute[74892]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:06:01 user nova-compute[74892]: </disk>
Nov 15 15:06:01 user nova-compute[74892]:  {{(pid=74892) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:06:01 user nova-compute[74892]: DEBUG nova.virt.libvirt.driver [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:06:02 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:06:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:06:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:10 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:15 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:06:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:06:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:20 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:06:21 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 is timed out.
Nov 15 15:06:21 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully detached device vdb from instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 from the live domain config.
Nov 15 15:06:21 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] calling os-brick to detach iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7efd20435f90>, {'target_iqn': 'iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbRqeVyh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:06:21 user nova-compute[74892]: WARNING os_brick.initiator.connectors.base [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[af20ade5-96b9-49ff-b41e-9099d275d6c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:06:21 user nova-compute[74892]: No targets found.
Nov 15 15:06:21 user nova-compute[74892]: iSNS:
Nov 15 15:06:21 user nova-compute[74892]: No targets found.
Nov 15 15:06:21 user nova-compute[74892]: STATIC:
Nov 15 15:06:21 user nova-compute[74892]: Target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e
Nov 15 15:06:21 user nova-compute[74892]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:06:21 user nova-compute[74892]:                 Iface Name: default
Nov 15 15:06:21 user nova-compute[74892]: FIRMWARE:
Nov 15 15:06:21 user nova-compute[74892]: No targets found.
Nov 15 15:06:21 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:06:21 user nova-compute[74892]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:06:21 user nova-compute[74892]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74892) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e', 0)] {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquired lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Forcefully refreshing network info cache for instance {{(pid=74892) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG nova.objects.instance [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lazy-loading 'info_cache' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8a930e-16b1-40dc-87ae-3f320bb1f3a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bd1c86-8c0e-44d9-9e4e-c0c8f31ed05f]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e (non-flash)\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e (non-flash)
Nov 15 15:06:21 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e (non-flash)
Nov 15 15:06:21 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7efd20520550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e'): ({'sdb'}, set())}) {{(pid=74892) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Removing single pathed devices sdb {{(pid=74892) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41a32c5-918d-457e-9f6f-e6e86c3c52fb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c89183b-0fbf-4e09-8842-4f6a305eeb57]: (4, ('ok\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Flushing IO for device /dev/sdb {{(pid=74892) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d1491-8570-468f-bf8c-cf15a4f42ecc]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74892) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:06:21 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a53325-1be0-4cd3-8781-ff4d49cf3297]: (4, ('1', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG os_brick.initiator.linuxscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] SCSI volumes sdb have been removed. {{(pid=74892) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e')] {{(pid=74892) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[4757b7be-6054-44f7-99bb-5d658d534192]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --logout {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[187cf1d8-1e2b-43b7-b8c8-0ace39734e3b]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e, portal: 172.16.0.220,3260]
Nov 15 15:06:22 user nova-compute[74892]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e, portal: 172.16.0.220,3260] successful.
Nov 15 15:06:22 user nova-compute[74892]:  stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op delete {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5ed092b-e0aa-4f7d-9f97-f82293bd0b6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo.privsep.daemon [-] privsep: reply[1220919c-9e98-42a9-bbaa-e00004c5d453]: (4, ('', '')) {{(pid=85038) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74892) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.base [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG os_brick.initiator.connectors.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] <== disconnect_volume: return (308ms) None {{(pid=74892) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG nova.virt.libvirt.volume.iscsi [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Disconnected iSCSI Volume {{(pid=74892) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG nova.network.neutron [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [{"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Releasing lock "refresh_cache-d8d9811d-8860-4c9d-9439-291cb3f9adb8" {{(pid=74892) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updated the network info_cache for instance {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG nova.objects.instance [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'flavor' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:06:22 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-231f6766-73d6-4f52-ae7f-624bc3c3aa50 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.638s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:06:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:06:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:06:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:06:23 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:06:23 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG oslo_concurrency.processutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74892) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:06:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:06:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:06:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=24.96712875366211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Instance d8d9811d-8860-4c9d-9439-291cb3f9adb8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74892) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:06:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:06:25 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:27 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:28 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:28 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:06:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:06:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:06:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:30 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:31 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:06:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:06:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:35 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:38 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:06:40 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:06:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74892) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:06:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74892) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:06:45 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:06:50 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:06:55 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:00 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:07:05 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:07:07 user nova-compute[74892]: INFO nova.compute.manager [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Terminating instance
Nov 15 15:07:07 user nova-compute[74892]: DEBUG nova.compute.manager [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Start destroying the instance on the hypervisor. {{(pid=74892) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-d61bd5b3-b895-47e4-a262-eb295206b3de req-7d8b936d-b638-44ba-9f17-35c964661113 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received event network-vif-unplugged-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d61bd5b3-b895-47e4-a262-eb295206b3de req-7d8b936d-b638-44ba-9f17-35c964661113 service nova] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d61bd5b3-b895-47e4-a262-eb295206b3de req-7d8b936d-b638-44ba-9f17-35c964661113 service nova] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d61bd5b3-b895-47e4-a262-eb295206b3de req-7d8b936d-b638-44ba-9f17-35c964661113 service nova] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-d61bd5b3-b895-47e4-a262-eb295206b3de req-7d8b936d-b638-44ba-9f17-35c964661113 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] No waiting events found dispatching network-vif-unplugged-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG nova.compute.manager [req-d61bd5b3-b895-47e4-a262-eb295206b3de req-7d8b936d-b638-44ba-9f17-35c964661113 service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received event network-vif-unplugged-70f3d159-1865-4889-ac78-20e4e09caf38 for instance with task_state deleting. {{(pid=74892) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:07:07 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [-] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Instance destroyed successfully.
Nov 15 15:07:08 user nova-compute[74892]: DEBUG nova.objects.instance [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lazy-loading 'resources' on Instance uuid d8d9811d-8860-4c9d-9439-291cb3f9adb8 {{(pid=74892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG nova.virt.libvirt.vif [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1493456313',display_name='tempest-SnapshotDataIntegrityTests-server-1493456313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1493456313',id=53,image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAIR7g7DWKMS+CQV433bDiQqB7qGL8SoLyl0vd3c7b3zyeyFhs0Xe9ulu3TCpEQ1OPdI4rlnd4W6noW0Mi1U3Af+w0S3Cw4kadCdD8SOqwfHNtRCkyNDU2w0tJ+CNq5yg==',key_name='tempest-keypair-732912768',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:00:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e32502e7314485293b0158e69fee495',ramdisk_id='',reservation_id='r-g9tgr2qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='557dbecf-dbbd-46c7-999f-66066c1bea36',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-672798861',owner_user_name='tempest-SnapshotDataIntegrityTests-672798861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9c59ac3d54c49f4b1d18079175e864e',uuid=d8d9811d-8860-4c9d-9439-291cb3f9adb8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Converting VIF {"id": "70f3d159-1865-4889-ac78-20e4e09caf38", "address": "fa:16:3e:76:c1:10", "network": {"id": "f52ab434-30cd-4a28-8f31-d46d68455e4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1801207861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e32502e7314485293b0158e69fee495", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70f3d159-18", "ovs_interfaceid": "70f3d159-1865-4889-ac78-20e4e09caf38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG nova.network.os_vif_util [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:c1:10,bridge_name='br-int',has_traffic_filtering=True,id=70f3d159-1865-4889-ac78-20e4e09caf38,network=Network(f52ab434-30cd-4a28-8f31-d46d68455e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f3d159-18') {{(pid=74892) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG os_vif [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c1:10,bridge_name='br-int',has_traffic_filtering=True,id=70f3d159-1865-4889-ac78-20e4e09caf38,network=Network(f52ab434-30cd-4a28-8f31-d46d68455e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f3d159-18') {{(pid=74892) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70f3d159-18, bridge=br-int, if_exists=True) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79370256-8674-48e1-af28-797e492806b7) {{(pid=74892) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:07:08 user nova-compute[74892]: INFO os_vif [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:c1:10,bridge_name='br-int',has_traffic_filtering=True,id=70f3d159-1865-4889-ac78-20e4e09caf38,network=Network(f52ab434-30cd-4a28-8f31-d46d68455e4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70f3d159-18')
Nov 15 15:07:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Deleting instance files /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8_del
Nov 15 15:07:08 user nova-compute[74892]: INFO nova.virt.libvirt.driver [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Deletion of /opt/stack/data/nova/instances/d8d9811d-8860-4c9d-9439-291cb3f9adb8_del complete
Nov 15 15:07:08 user nova-compute[74892]: INFO nova.compute.manager [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 15:07:08 user nova-compute[74892]: DEBUG oslo.service.loopingcall [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74892) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG nova.compute.manager [-] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Deallocating network for instance {{(pid=74892) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] deallocate_for_instance() {{(pid=74892) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG nova.network.neutron [-] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Updating instance_info_cache with network_info: [] {{(pid=74892) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:07:08 user nova-compute[74892]: INFO nova.compute.manager [-] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Took 0.66 seconds to deallocate network for instance.
Nov 15 15:07:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:07:08 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:07:09 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:07:09 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:07:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:07:09 user nova-compute[74892]: INFO nova.scheduler.client.report [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Deleted allocations for instance d8d9811d-8860-4c9d-9439-291cb3f9adb8
Nov 15 15:07:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-55ffcddc-8d7b-4e75-abab-93d8e11ba7c4 tempest-SnapshotDataIntegrityTests-672798861 tempest-SnapshotDataIntegrityTests-672798861-project-member] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.904s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:07:09 user nova-compute[74892]: DEBUG nova.compute.manager [req-d2b996f5-b269-472d-9c76-07d211f6c53e req-464b32b1-5ccf-45ee-8cbe-a8b50609650b service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received event network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:07:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d2b996f5-b269-472d-9c76-07d211f6c53e req-464b32b1-5ccf-45ee-8cbe-a8b50609650b service nova] Acquiring lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:07:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d2b996f5-b269-472d-9c76-07d211f6c53e req-464b32b1-5ccf-45ee-8cbe-a8b50609650b service nova] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:07:09 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [req-d2b996f5-b269-472d-9c76-07d211f6c53e req-464b32b1-5ccf-45ee-8cbe-a8b50609650b service nova] Lock "d8d9811d-8860-4c9d-9439-291cb3f9adb8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:07:09 user nova-compute[74892]: DEBUG nova.compute.manager [req-d2b996f5-b269-472d-9c76-07d211f6c53e req-464b32b1-5ccf-45ee-8cbe-a8b50609650b service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] No waiting events found dispatching network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:07:09 user nova-compute[74892]: WARNING nova.compute.manager [req-d2b996f5-b269-472d-9c76-07d211f6c53e req-464b32b1-5ccf-45ee-8cbe-a8b50609650b service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received unexpected event network-vif-plugged-70f3d159-1865-4889-ac78-20e4e09caf38 for instance with vm_state deleted and task_state None.
Nov 15 15:07:09 user nova-compute[74892]: DEBUG nova.compute.manager [req-d2b996f5-b269-472d-9c76-07d211f6c53e req-464b32b1-5ccf-45ee-8cbe-a8b50609650b service nova] [instance: d8d9811d-8860-4c9d-9439-291cb3f9adb8] Received event network-vif-deleted-70f3d159-1865-4889-ac78-20e4e09caf38 {{(pid=74892) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:07:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:22 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:07:23 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:07:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:07:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:07:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=24.994224548339844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:07:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:07:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:07:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:07:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:07:24 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:07:24 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:07:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:07:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:07:25 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:28 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:07:28 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:28 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74892) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:07:29 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:32 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:33 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:38 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:07:39 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:43 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:07:48 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:49 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:07:53 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:07:58 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:08:01 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:08:03 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:08:04 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:08:08 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:08:13 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:08:18 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:08:23 user nova-compute[74892]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74892) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:08:23 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:08:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:08:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:08:23 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:08:23 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Auditing locally available compute resources for user (node: user) {{(pid=74892) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:08:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:08:24 user nova-compute[74892]: WARNING nova.virt.libvirt.driver [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:08:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Hypervisor/Node resource view: name=user free_ram=9245MB free_disk=24.97256851196289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74892) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:08:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:08:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:08:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:08:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74892) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:08:24 user nova-compute[74892]: DEBUG nova.compute.provider_tree [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed in ProviderTree for provider: f0684847-d6be-43f9-9eb9-f058843467dc {{(pid=74892) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:08:24 user nova-compute[74892]: DEBUG nova.scheduler.client.report [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Inventory has not changed for provider f0684847-d6be-43f9-9eb9-f058843467dc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74892) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:08:24 user nova-compute[74892]: DEBUG nova.compute.resource_tracker [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Compute_service record updated for user:user {{(pid=74892) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:08:24 user nova-compute[74892]: DEBUG oslo_concurrency.lockutils [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74892) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:08:25 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:08:25 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:08:25 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Starting heal instance info cache {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:08:25 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Rebuilding the list of instances to heal {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:08:25 user nova-compute[74892]: DEBUG nova.compute.manager [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Didn't find any instances for network info cache update. {{(pid=74892) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:08:25 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:08:26 user nova-compute[74892]: DEBUG oslo_service.periodic_task [None req-ba7bab16-8121-4b49-b3bc-59f157a9fa56 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74892) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}